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1.  INTRODUCTION 


1.1  Overview  of  the  Report 

This  report  summarl zes  the  first  phase  program  activities  of  a  three-year 
program  of  research  and  development  directed  toward  the  analysis  and 
evaluation  of  myoelectric  signals  (MES)  as  indicators  of  operator 
alertness,  and  potentially  workload  In  aircraft  piloting  tasks.  The 
purpose  of  the  study  Is  to  Investigate  the  efficiency  of  stochastic  models 
such  as  autoregressive  (AR),  autoregressive-moving-average  (ARMA)  and 
autoregressive  integrated  moving  average  (ARIMA)  models  In  characterizing 
the  MES  under  different  levels  of  task  Imposed  burden. 

The  specific  objectives  of  this  effort  are: 

(1)  To  develop/adapt  state-of-the-art  stochastic  models  for 
characterizing  myoelectric  signal  patterns. 

(2)  To  Investigate  under  controlled  experimental  conditions  If 
meaningful  repeatable  quantitative  relationships  can  be 
identified  between  MES  patterns  and  operator  loading. 

(3)  To  experimentally  Identify  muscle  sites  that  provide  reliable 
MES  signatures. 

(4)  To  develop  methods  and  procedures  for  "tuning"  the  models  and 
possibly  "filtering  out"  pattern  variations  due  to  variables 
In  electrode  locations  and  Individual  biases. 

(5)  To  develop  guidelines  for  automatically  assessing  operator 
alertness  level  from  the  MES  temporal  signature  In  piloting 
tasks. 


The  three  year  R&D  program  builds  on  the  research  performed  by  Madnl  (1978, 
1981)  and  Graupe;  et  al  (1975,  1977).  The  results  of  these  research  works 
established  the  feasibility  of  stochastic  models  In  characterizing  sampled 
myoelectric  signal  waveforms.  In  particular,  the  work  of  Madnl  established 
the  feasibility  of  stochastic  models  In  characterizing  myoelectric  signals 
under  varying  levels  of  muscle  tension  and  fatigue.  The  work  reported  here 
consists  of  findings  and  results  associated  with  the  program's  first  phase. 
The  specific  areas  covered  are:  (1)  the  model  development  (2)  the  system 
Implementation  and  (3)  preliminary  experimental  evaluation  of  ARIMA 
model -based  analysis  of  myoelectric  signals  and  Its  relationship  to  task 
performance.  Thus  far  the  model  has  been  Implemented  In  Percept ronlcs' 
myoelectric  data  collection  laboratory  and  preliminary  experiments  have 
been  conducted  to  determine  the  diagnostic  capability  of  the  model.  Work 
Is  currently  underway  to  build  on  and  extend  the  current  experimental  work 
both  to  provide  a  firm  analytical  and  experimental  basis  and  to  develop 
techniques  for  improved  data  Interpretation  and  algorithmic  accuracy. 

1.2  Problem  Statement 

The  definition  and  derivation  of  objective  measures  for  assessing  workload, 
attentlonal  demands  or  operator  alertness  In  specific  piloting  tasks  has 
been  an  area  of  Investigation  by  several  researchers  for  more  than  three 
decades.  Myoelectric  signals  (MES)  have  been  the  object  of  study  by  some 
researchers  (Kennedy  and  Travis,  1947;  Travis  and  Kennedy,  1947;  Kennedy, 
1953)  searching  for  a  physiological  Indication  of  alertness  In  piloting 
tasks.  The  results  of  these  experiments  demonstrated  that  there  appeared 
to  be  some  correlation  between  MES  properties  (e.g.,  spike  amplitude,  zero 
crossings)  and  human  alertness;  however,  the  use  of  these  properties  as  an 
Indicator  of  alertness  level  was  never  successfully  Incorporated  In  a 
practical  setting  primarily  because  of  the  excessively  high  false  positives 
In  certain  tasks,  l.e.,  diminished  alertness  was  Identified  In  many 
situations  when  the  subject  was  perfectly  alert.  One  plausible  explanation 


for  this  unreliability  In  "answers"  extracted  from  MES  signatures  Is  that 
the  Information  content  of  the  original  MES  waveform  Is  underutilized.  In 
other  words,  the  reliability  of  features,  the  Information  content  of  the 
features,  and  the  feature  extraction  process  are  critical  to  the  success  of 
the  alertness/workload  level  discrimination  process. 

1.3  Major  Hypotheses  and  Modelling  Approach. 

Stochastic  modelling  and  time  series  analysis  methods  have  been  extensively 
used  to  statistically  model  the  relationship  between  the  amplitude  of  a 
signal  at  different  points  In  time  along  the  entire  time  history.  In  this 
model,  fluctuations  In  amplitude  along  the  timeline  are  treated  as  a 
stochastic  process.  Stochastic  models  are  particularly  well-suited  as  a 
temporal  feature  extraction  tool  for  time  varying  random  signals.  Features 
thus  extracted  retain  sufficient  Information  from  the  original  signal  and, 
consequently,  are  known  to  succeed  In  terms  of  feature  dlagnostlclty  In 
applications  where  purely  spectral  or  ad  hoc  feature  extraction  methods 
have  failed  (Madnl,  1978).  The  key  hypotheses  underlying  the  use  of 
stochastic  models  as  a  feature  extraction  method  for  Identifying  operator 
alertness  levels  are  that:  (1)  at  least  one  model  coefficient  (feature) 
will  be  relatively  constant  and  repeatable  for  the  mental  load  category  and 
task  during  which  the  signal  was  recorded;  and  (2)  at  least  one  of  these 
nearly  constant  features  associated  with  each  alertness  category /load 
condition  will  be  sufficiently  different  for  each  load  category  thus 
allowing  Identification  of  the  category. 

Stochastic  modelling  Is  well -suited  to  modelling  physiological  data  that 
possess  one  or  more  of  the  following  characteristics: 

(1)  The  data  trace  Is  noisy,  l.e.,  data  points  show  random 
fluctuations  in  amplitude  and  are  thus  amenable  to  being 
modelled  as  a  random  sequence. 


(2)  The  classification  problem  Is  restricted  to  a  finite, 
previously  established  number  of  categories. 

(3)  Simpler  feature  extraction  methods  such  as  power  spectrum 
analysis,  root-mean- square- value  estimation  and  signal 
amplitude  coding  fall  to  provide  good  separation  among  the 
classes. 

The  key  research  problems  forming  the  basis  of  this  study  and  underlying 
the  use  of  stochastic  models  as  a  feature  extraction  method  are: 

(1)  The  MES  recorded  from  selected  muscle  groups  are  correlated 
with  Internal  states  of  the  human  operator,  e.g.,  alertness 
level  or  mental  load;  consequently,  the  underlying  operator 
state  can  potentially  be  reliably  diagnosed/ inferred  via 
features  extracted  from  the  corresponding  MES  signatures. 

(2)  The  Feature  extraction  process  associated  with  stochastic 
model  characterization  of  the  MES  waveforms  Is  potentially 
capable  of  "capturing"  features  that  are  both  repeatable  and 
diagnostic.  Repeatability  Implies  that  there  Is  at  least  one 
parameter  In  the  stochastic  model  characterization  of  MES  data 
that  Is  constant  or  near-constant  for  each  underlying  level  of 
alertness  or  load  In  a  given  task.  Dlagnostlclty  Implies  that 
these  nearly  Invariant  features  are  sufficiently  different  for 
each  level  of  alertness,  thereby  allowing  Identification  of 
the  underlying  operator  state. 


The  fCS  within  the  context  of  human  performance  and  workload  has  been 
studied  by  various  researchers  over  the  last  three  decades.  Within  the 
context  of  human  performance,  the  MES  can  be  potentially  used  to  provide  a 
measure  of  either  activity  of  the  muscles  or  the  tension  of  the  muscles. 
When  workload  estimation  is  involved,  data  processing  of  some  kind  has  to 
be  performed  on  the  raw  MES  data.  This  processing  can  range  from 
conventional  signal  processing  and  filtering  methods  to  temporal  feature 
extraction  and  pattern  analysis  methods. 

A  number  of  studies  have  been  carried  out  to  demonstrate  the  practical 
value  of  MES  as  a  measure  of  task  workload  and  performance  quality.  Among 
the  earliest  research  is  that  of  Kennedy  and  Travis  (1947,  1948,  1949)  who 
found  that  the  level  of  the  Integrated  MES  recorded  over  the  supraorbital 
facial  area  was  closely  related  to  vigilance  and  tracking  performance. 
Lucacclnl  (1968)  observed  similar  changes  In  the  integrated  forearm  flexor 
muscle  MES  during  simple  and  complex  visual  tasks.  He  also  reported  that 
the  average  Intrasubject  correlations  between  MES  and  performance  were 
highly  significant  In  both  tasks  (r  *  .21  and  .30  In  simple  and  complex 
tasks,  respectively).  Stern  (1966)  found  that  integrated  neck  MES  rose 
Initially  and  fell  thereafter  during  easier  and  more  difficult  (lower 
signal  frequency)  versions  of  a  simple  visual  task. 

It  seems  from  these  results  that  Integrated  MES  voltage  Is  one  of  the 
better  predictors  of  vigilance  performance,  but  It  has  not  been  universally 
accepted  that  MES  varies  directly  with  vigilance  task  performance.  Eason 
et  al  (1965)  Interpreted  their  results  as  Indicating  that  sympathetic 
activity  decreases  along  with  CNS  arousal  and  vigilance,  but  that  somatic 
activity  Increases  as  part  of  a  compensatory  process.  Groll's  conclusions 


(1966)  were  essentially  the  same.  Yet,  judging  from  their  results  and  the 
contradictory  findings  of  others,  muscle  tension,  like  performance,  may 
reflect  both  the  processes  underlying  declines  In  vigilance  performance  and 
those  acting  to  counteract. 

Jex  and  Allen  (1970)  found  that  rectified  and  suitably  filtered  MES's 
recorded  from  the  forearm  of  subjects  showed  a  decrease  In  amplitude  when 
subjects  changed  from  a  resting  to  a  tracking  state.  These  researchers 
also  found  that  grip  pressure  was  found  to  Increase  with  Increase  In 
tracking  difficulty.  Sun  et  al  (1976)  and  Stackhouse  (1976)  found  that  MES 
from  the  forehead  and  the  forearm  were  correlated  with  task  loading  In  a 
variety  of  aircrew  tasks.  Madnl  (1978)  found  a  stable  correlation  between 
MES  recorded  during  Isometric  contraction  of  the  deltoid  muscle  at  various 
load  levels  and  the  parameters  of  the  stochastic  models  used  to 
characterise  the  MES  waveform. 

Luclanl  et  al  (1983)  at  the  Aerospace  Medical  Research  Laboratory  at  the 
Wrlght-Patterson  AFB  explored  the  use  of  the  Fast  Fourier  transform  to 
determine  operating  fatigue  by  analysis  of  the  center  frequencies  and 
amplitudes  of  the  sampled  power  spectra.  These  researchers  Indicate  that 
while  they  were  successful  at  optimizing  the  acquisition  and  processing  of 
the  MES,  reproducibility  of  data,  especially  In  a  dynamic  environment, 
remained  a  challenging  task.  Kranz  et  al  (1983)  examined  the  frequency 
content  of  the  MES  when  subjects  performed  45- sec  contractions  of  the 
thenar  muscles.  The  median  frequencies  (Fm)  of  surface- recorded  MES  and 
compound  action  potentials  were  similar  early  (P  greater  than  0.6)  and  late 
(P  greater  than  0.5)  In  the  contractions.  There  was  a  mean  decrease  In  the 
Fm  during  contraction  of  39%  for  0.1).  The  Fm  of  the  MES  increased  11%  (P 
less  than  0.02  to  100%  of  maximum.  Only  one  of  five  subjects  showed 
evidence  of  Increasing  synchronization  of  motor  unit  discharge  during 
contraction.  There  was  no  evidence  that  delay  or  dispersion  of  action 
potential  propagation  In  terminal  nerve  fibers  or  at  the  neuromuscular 


junction  had  a  significant  effect  on  frequency  content.  The  findings 
Indicated  that  the  spectral  content  of  muscle  electrical  activity,  and  Its 
shift  during  contraction,  primarily  reflects  Intrinsic  muscle  properties. 

Llndstrom  et  al  (1963)  studied  localized  muscle  fatlque  in  the  masseter 
muscle  with  a  method  based  on  power  spectrum  analysis  of  MES.  They  found 

that  under  the  Influence  of  fatiguing  contractions,  a  gradual  shift  of  the 

spectral  curve  occurred;  the  rate  of  change  was  taken  as  a  measure  of  the 

development  of  fatigue.  The  fatigue  was  dependent  on  the  bite  force.  The 

existence  of  a  threshold  value  of  force,  below  which  significant 
myoelectric  fatigue  changes  do  not  develop,  was  shown. 

Phillips  et  al  (1983)  studied  quantitative  electromyography  techniques  in 
evaluating  the  response  of  the  neck  muscles  to  conventional  helmet 
weighting  (physical  fatigue).  Their  results  Indicate  that  the  EMG  of  neck 
muscles  can  be  used  as  a  nonlnvaslve,  objective  and  quantitative  Index  of 
the  neck  muscle  fatigue. 

Chrlstakos  (1982)  conducted  a  study  of  the  electromyogram  using  a 
population  stochastic  model  of  the  skeletal  muscle.  The  researcher  studied 
the  features  of  the  electromyogram  (EMG)  using  a  population  model  of 
skeletal  muscle  based  on  the  differing  properties  and  the  Independent 
activation  of  motor  units  (MUs).  He  showed  both  analytically  and  by 
computer  simulation,  that:  (a)  The  power  spectrum  of  the  EMG  is 
determined  by  the  distribution  of  filtering  and  firing  properties  of  the 
active  MUs.  (b)  A  tendency  towards  a  rhythmical  grouping  of  action 
potentials  Is  to  be  expected  from  a  set  of  asynchronous  MUs  firing 
semlregularly  at  similar  rates;  the  grouped  electrical  activity  has  a 
phase-lead  over  the  force  output  of  the  set  of  about  180  degrees.  He 
provided  a  unified  explanation  of  the  properties  of  the  muscle  force 
waveform  and  the  electromyogram,  In  terms  of  asynchronous  activity  of  MUs, 
Is  proposed.  The  explanation  covers  the  relationship  and  the  differences 
between  the  two  signals. 


1.5 


Stochastic  Model s 


Stochastic  Modelling  (also  referred  to  as  time  series  analysis)  has  been 
used  extensively  to  model  the  statistical  relationship  between  the 
amplitude  of  a  signal  at  any  point  In  time  and  the  preceding  amplitudes 
along  the  time  history  (Box  et  al,  1970).  The  amplitude  fluctuations  along 
the  time  line  are  treated  as  a  stochastic  process.  The  future  course  of 
the  process  Is  presumed  to  be  predictable  from  Information  about  Its  past. 

Before  describing  these  models,  the  notation  employed  will  be  summarized. 

e  Let 


be  a  discrete  time  series  where  Xj  Is  the  random  variable  X  at 
time  1.  We  denote  the  series  by  [X]. 

e  Let  v  be  the  mean  of  [X],  called  the  level  of  the  process. 

•  Let  [x]  denote  the  series  of  deviations  about  w;  that  Is, 

xi  ■  xi  - u 

•  Let  [w]  be  a  series  of  outputs  frow  a  white  noise  source  with  a 
mean  zero  and  variance  a  . 


•  Let  B  be  the  "backward"  shift  operator  for  the  deviation  series 
such  that 


•  Let  v  be  the  backward  difference  operator  for  the  deviation 
series  such  that 


The  dependence  of  the  current  value  x^  on  the  past  values  of  x  and  w  can  be 
expressed  In  different  ways  giving  rise  to  several  different  models. 

(a)  Autoregressive  (AR)  Models.  In  this  model  the  current  value  of  x 
depends  on  the  previous  p  values  of  x  and  on  the  current  noise  term  w. 

Thus, 


The  series  [x]  as  defined  above  Is  known  as  the  autoregressive  process  of 
order  p.  The  name  "autoregressive"  arises  from  the  model's  similarity  to 
regression  analysis  and  the  fact  that  the  variable  x  In  an  AR  model  Is 
regressed  on  previous  values  of  Itself. 


(b)  Moving  Average  (MA)  Model.  In  the  equation  for  the  AR  model, 
can  be  eliminated  from  the  expression  for  x^  by  substituting 

xk-l  *  alxk-2  +  a2xk-3  +  — +  Vk-p-1  +  Vl 

This  process  can  be  repeated  to  eventually  yield  an  equation  for  xfc  as  an 
Infinite  series  In  the  w's.  A  moving  average  model  allows  a  finite  number 
q  of  previous  w  values  In  the  expression  for  x^.  This  formulation 
explicitly  treats  the  series  as  being  observations  on  linearly  filtered 
Gaussian  noise.  A  MA  process  of  order  q  Is  given  by 
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(c)  Mixed  Model:  Autogressl ve-MovI ng  Average  (ARMA)  Model.  To  achieve 
flexibility  In  the  fitting  of  actual  time  series,  this  model  .Includes  both 
the  AR  and  the  MA  terms.  A  (p,q)  AIWA  model  has  the  form: 


xk  *  f  a1xk-1  *  \  “  l  b1wk-1 
1-1  1-1 


In  all  three  models  described  above  the  process  generating  the  series  Is 
assumed  to  be  In  equilibrium  about  a  constant  mean  level.  Models 
characterized  by  such  an  equilibrium  condition  are  called  stationary 
models.  Functional  separation  of  MES  using  this  model  has  been  tried  as  a 
means  of  prosthesis  control  (Graupe,  et  al,  1975). 


In  certain  time  series  data,  the  level  v  does  not  remain  constant,  l.e.,  the 
series  Is  nonstationary.  The  series  may,  nevertheless,  exhibit  homogeneous 
or  stationary  behavior  after  the  differences  due  to  level  drift  have  been 


accounted  for.  It  can  be  shown  that  such  behavior  can  In  certain  Instances 
be  represented  by  an  autoregressive- Integrated-moving-average  (ARIMA) 
model. 


where  xk  is  the  original  time  series 

v  Is  the  backward  difference  operator 

d  Is  the  number  of  differencing  operations  performed  on  the  original 
data. 

p  Is  the  order  of  the  autoregressive  terms 
q  Is  the  order  of  the  moving  average  terms 

If  yk  * 

P  P 

The"  *k  *  ^  Vk-1  *  "k  -  ^  b("k-t 

This  model  Is  referred  to  as  a  general  (p,d,q)  model  referring  to  a  general 
pth  order  autoregressive  dth  data  differencing,  qth  order  moving  average 
process  (Box  et  al,  1970). 

1.6  ARIMA  Models  In  MES  Characterization 

The  feasibility  of  ARIMA  Stochastic  Model  Identification  for  feature 
extraction  was  explored  by  Madnl  (1978).  The  key  elements  of  this  study 
are  provided  In  the  following  paragraphs. 


The  experimental  data  consisted  of  MES  records  from  the  deltoid  muscle  for 
different  Isometric  contraction  levels.  These  ranged  from  01  to  1001, 
where  1001  tension  Is  defined  as  1001  of  the  force  generated  at  maximum 
effort,  not  1001  of  MES.  The  primary  assumption  In  this  experiment  Is  that 
an  XI  run  corresponds  to  XI  of  muscle  tension  which  Is  proportional  to 
abduction,  and  that  the  only  muscle  Involved  In  abduction  Is  the  deltoid. 

The  results  of  the  spectral  analysis  performed  on  the  experimental  data 
revealed  a  gradual  but  definite  shift  of  power  to  lower  frequencies  with 
Increase  In  muscle  contraction.  The  total  power  of  the  signal  was  found  to 
lie  below  2500  Hz.  The  most  significant  shift  of  power  to  lower 
frequencies  with  Increasing  muscle  tension  was  observed  In  the  frequency 
band  that  contained  ninety  percent  of  the  total  power. 

ARIMA  models  were  fitted  to  the  MES  data  recorded  for  each  contraction 
level.  The  ARIMA  parameters  were  fitted  across  the  n  trials  for  each 
contraction  level.  It  was  found  that  the  AR  terms  were  relatively  constant 
for  the  11,  51  ...»  501  tension  levels;  however,  the  AR  coefficients  for 
the  1001  tension  level  were  quite  different  (both  In  sign  and  magnitude) 
from  those  for  all  other  tension  levels.  These  and  other  findings  (Graupe, 
1975)  provided  the  Impetus  for  exploring  the  stochastic  modelling  approach 
as  a  viable  feature  extraction  tool. 

1.7  Program  Objectives  for  the  First  Phase 

The  specific  objectives  of  the  first  phase  of  the  current  program  are: 


(1)  To  develop  an  ARIMA  stochastic  model -based  approach  for 
Identifying  operator  alertness  and  workload  levels. 


(2)  To  develop  and  Implement  stochastic  model -based  MES  pattern 
analysis  software  within  the  overall  data  acquisition  and 
processing  system. 

(3)  Develop  an  experimental  plan  and  a  representative  task 
simulation  and  Interface. 

(4)  Perform  the  pilot  experiment  Investigation. 

(5)  To  Identify  model  structure,  via  model  parameter  Identi¬ 
fication  processes. 

(6)  To  evaluate  the  model -derived  features  In  terms  of  their 
relevance  to,  or  association  with  operator  alertness  level 
and/or  mental  load. 
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2.  SYSTEM  IMPLEMENTATION  AND 
EXPERIMENTAL  SET-UP 


2.1  Overview 


This  chapter  gives  a  description  of  the  hardware  and  Instrumentation 
currently  used,  our  selection  criteria,  and  the  modifications  required  to 
Integrate  the  overall  system.  The  software  modules  required  to  perform  the 
ARIMA  Identification  process  are  described  In  detail  along  with  an 
explanation  of  the  Box  and  Jenkins  Identification  procedure.  Also  Included 
Is  a  summary  of  the  ARIMA  model  Identification  process  and  the  system 
software. 


2.2  Hardware  And  Instrumentation 

2.2.1  Development  System  Selection.  Very  early  In  the  project,  we  made 
the  decision  to  separate  the  computer  system  Into  two  major  components. 
One  subsystem  would  be  responsible  for  collecting  MES  data  while  the 
subject  was  performing  a  prescribed  task.  This  same  system  would  be  used 
to  analyze  the  collected  MES  data  (off-line)  after  termination  of  the 
experiment.  By  using  the  same  system  for  both  data  collection  and 
analysis,  we  bypass  the  problems  associated  with  transferlng  large  data 
files  between  systems.  A  second  subsystem  would  be  responsible  for 
controlling  the  experiments  and  collecting  behavioral  performance  data 
during  the  experiment. 

We  considered  a  number  of  systems  that  were  potentially  suitable  for  MES 
data  acquisition  and  analysis,  and  the  required  software  development.  Our 
experience  with  microcomputers  based  on  8-blt  processors  was  that  they  had 
Inadequate  speed  for  performing  complex  computations.  Consequently,  we 
decided  upon  the  16-bit  microcomputer  family  within  which  we  evaluated 
several  alternatives. 
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We  favored  16-bit*  micros  that  support  the  UNIX  operating  system.  This  Mas 
done  for  three  main  reasons.  First,  UNIX  Is  a  known  and  popular  system  for 
experimental  software  development.  Second,  the  specific  file  management 
facilities  available  under  UNIX  provide  us  with  an  efficient  way  of 
creating  and  maintaining  the  Integrity  of  the  various  program  and  data 
files.  Third,  we  had  significant  experience  with  the  UNIX  operating  system 
and  foresaw  a  shortening  of  the  software  development  time  under  UNIX.  Of 
the  three  popular  16-bit  microcomputers,  l.e..  Motorola's  68000,  Intel's 
8086,  and  National's  16000,  only  Motorola  supported  the  UNIX  operating 
system  at  the  time  of  system  selection.  Our  next  major  decision  was  to 
decide  on  a  specific  68000-based  development  system  and  vendor.  Of  the 
68000  based  systems  supporting  UNIX,  we  Identified  eight  candidates: 
Codata  Corp.;  Callan  Data  Systems;  COSMOS  Systems,  Inc.;  Cromemco,  Inc.; 
Fortune  Systems;  Forward  Technology,  Inc.;  Plexus;  and  Dual  Systems  Corp. 
Our  criteria  for  selecting  the  system  was  three-fold:  cost,  availability 
and  support  by  vendor.  We  selected  the  COSMOS  system  on  the  basis  of 
Immediate  availability,  support  by  a  Northern  California-based  vendor,  and 
relatively  competitive  price. 

There  Is  an  upper  limit  of  16M  bytes  of  memory  that  can  be  addressed  with 
the  24-bit  addressing  capability  of  the  Motorola  68000.  We  needed  adequate 
memory  to  run  the  ARIMA  algorithm  which  requires  large  arrays  for  data 
storage.  At  least  256K  bytes  were  needed  for  this  algorithm  plus  the 
operating  system.  We  thus  decided  to  opt  for  either  256K  bytes  or  5I2K 
bytes  of  RAM,  depending  on  the  basic  68000-based  system's  minimal  memory 
configuration. 

Additionally,  a  large  amount  of  hard  disk  storage  was  required  for  storing 
the  large  MES  data  files  In  addition  to  all  of  the  data  collection  and 
ARIMA  analysis  program  files.  We  calculated  that  we  would  require  at  least 
a  20M  byte  hard  disk. 


We  also  required  a  system  which  had  a  widely  used  bus  so  that  we  could  add 
peripheral  boards;  In  particular,  we  needed  a  good  Analog-to-DIgltal 
Convertor  board  to  collect  and  digitize  MES  data.  Candidates  busses  were 
the  Q-bus  and  Multibus.  Of  the  two.  Multibus  had  the  greatest  number  of 
peripheral  boards  available. 

As  Indicated,  we  confined  ourselves  to  systems  that  supported  UNIX.  In 
addition  we  decided  to  do  the  software  development  In  the  C  language.  C  Is 
a  medium  level  language.  That  Is,  It  supports  high  level  commands  but 
executes  almost  as  fast  as  assembly  language.  C  therefore  allows  efficient 
coding  (both  In  terms  of  memory  requirements  and  execution  time)  at  both  a 
high-level  (l.e.,  algorithms)  and  a  low  level  (l.e.,  device  "drivers")  of 
coding. 

The  MULT I BUS -based  COSMOS  CMS16/UNX  system  we  selected  has  the  following 
hardware  and  software  capabilities:  68000  CPU  with  DMA  and  vectored 
Interrupt  capability  and  memory  management  hardware,  51Zk  Bytes  RAM,  eight 
RS-232  serial  parts,  real-time  clock,  one  40M  Byte  hard  disk  system,  one 
25M  Byte  fixed/25  M  Byte  removable  hard  disk  subsystem,  one  Hazel  tine 
Esprit  terminal.  Software  Included:  UNIX  version  7  operating  system  with 
Berkeley  extensions  (multi-user,  multi-tasking),  C  programming  language, 
68000  assembler  and  various  UNIX  utilities  (l.e.,  editor,  linker,  debugger, 
etc.). 

In  addition  to  our  68000  based  system  we  needed  a  low  cost  computer  with 
graphics  capability  to  support  task  presentation  and  performance  monitoring 
software.  We  decided  on  a  multiprocessing  architecture  using  both  the 
COSMOS  and  an  Apple  lie.  We  partitioned  the  role  of  the  two  processors  In 
such  a  way  that  the  68000  system  was  used  only  for  data  collection  and 
subsequent  analysis  and  the  Apple  was  used  for  realtime  task  presentation 
and 
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and  performance  monitoring.  Along  with  our  Apple  lie  system  we  purchased 
a  GRAFORTH  (a  good  graphics  oriented  language)  compiler  to  support  the 
graphics  requirements  associated  with  the  experimental  tasks. 

The  Apple  lie  was  obtained  from  COMPUPLUS.  Equipment  Included  the  basic 
computer  with  an  80  column  card,  64k  Bytes  of  RAH,  an  Apple  monochrome 
monitor  with  stand,  two  floppy  disk  drives,  two  RS232  serial  Interfaces,  a 
parallel  Interface,  a  joystick,  and  an  OKIDATA  82A  line  printer . 

Functionally,  the  data  collection  and  analysis  Is  performed  by  the  Motorola 
68000.  The  actual  experiment  Is  displayed  on  the  Apple  monitor  and  the 
user  responds  with  either  a  button  pad  or  joystick  attached  to  the  He. 
The  two  systems  communicate  with  each  other  over  an  RS-232  Interface  cable. 

2.2.2  Analog-to-DIgltal  Board  Selection  and  Hardware  Interface.  Central 
to  this  experiment  was  the  requirement  to  collect  analog  myoelectric 
signals  which  are  sampled,  digitized,  and  stored  for  future  analysis. 
Sampling  and  digitizing  the  MES  was  performed  by  an  Analog  Devices  RTI-711 
A/D  board.  It  was  found  that  the  A/D  board  had  to  be  modified  slightly  to 
respond  to  the  MULTIBUS  read/write  signals  generated  by  the  COSMOS  CPU 
board.  This  modification  was  made  and  the  A/D  board  was  successfully 
debugged.  A  device  driver  program  described  In  detail  In  Section  2.3.5  was 
written  and  Integrated  with  the  UNIX  operating  system. 

The  of f-the-shel f  A/D  board  comes  with  a  16.384  KHz  crystal  controlling  the 
clock  rate.  We  replaced  the  standard  crystal  with  one  capable  of 
generating  a  32.768  KHz  clock  rate.  This  gave  us  a  maximum  sampling  rate 
under  Interrupt  control  of  2048  samples  per  second.  This  Implies  that  If 
we  wish  to  sample  N  multiplexed  channels,  the  sampling  rate  of  each  channel 
would  be  2048/N. 


2.2.3  Electrode  Selection  and  Interface  Design.  In  the  selection  of 
electrodes,  we  decided  against  using  the  standard  disposable  type  of  EMG 
electrodes  because  they  would  require  the  purchase  or  construction  of  a 
multi-channel,  high  performance  Instrumentation  amplifier.  We  Instead 
decided  to  use  EMG  electrodes  with  the  signal  processing  circuitry  resident 
In  a  common  package.  The  electrodes  were  supplied  by  Motion  Control 
Incorporated  of  Salt  Lake  City.  They  consist  of  differential  Inputs  spaced 
3.5  cm  apart,  a  central  ground  tap  and  a  high  performance  EMG  preamplifier 
In  a  single  package.  The  preamplifier  characteristics  are  shown  In  Table 
2-1: 

TABLE  2-1 

PREAMPLIFIER  CHARACTERISTICS 

e  Gain  -  360  @  500  Hz. 
e  CMRR  -  102dB  0  500  Hz. 

e  Frequency  Response  -  Flat  from  10Hz  to  42KHz 
•  Input  Impedance  -  100,000  Megohms 
e  Power  requirements  _+  6-15  VDC. 

While  the  electrical  characteristics  of  these  electrodes  were  Indeed 
Impressive,  their  physical  size  (5cm  x  1.5cm  x  0.8cm)  precluded  the  use  of 
certain  desirable  muscles  (l.e.,  frontalis).  In  order  to  eliminate  the 
possibility  of  ground-loops  and  to  effectively  Isolate  the  subjects  from 
the  main  supply  current,  a  separate  battery  supply  was  used  to  power  the 
electrode  circuitry  rather  than  using  the  supply  lines  available  from  the 
data  acquisition  system.  A  box  containing  the  batteries  and  the  hardware 
necessary  to  Interface  the  electrodes  to  the  A/D  board  was  constructed. 
This  box  also  housed  the  electrode  select  switches  and  low  battery 
Indicator  lamps.  These  lamps  were  driven  using  power  from  the  data 


acquisition  system  supply  lines  so  as  not  to  Induce  undo  power  drain  on  the 
batteries.  A  comparator  circuit  was  used  to  toggle  the  lamps  when  battery 
power  fell  below  a  preset  level. 


2.3  Modelling  and  System  Software 

2.3.1  ARIMA  Model  Identification.  As  Is  shown  earlier,  an  ARIMA  model 
for  a  general  time  series  has  d  -  levels  of  differencing,  p  - 
autoregressive  coefficients,  and  q  -  moving  average  coefficients  as  seen  In 
the  equation  below: 

^  ”  ^1^  ^t-1  ■ 1 ’  ’  ^t-p  *  at  ”  ®i ®t— 1  ”  •••  “  eqat-q 


vdZu  is  the  dth  difference  of  the  time  series  at  time  u, 

au  Is  the  zero  mean,  normal ly-dlstrlbuted  random  noise  at  time  u. 

+i  Is  the  1,th  autoregressive  coefficient. 

Is  the  1,th  moving  average  coefficient. 


Determination  of  p,  d,  and  q  Is  a  three  step  procedure.  The  first  step  of 
the  ARIMA  modelling  as  provided  In  Box  A  Jenkins  (1970)  Is  to  Identify  p, 
d,  and  q.  The  specific  software  module  associated  with  this  step 
calculates  autocorrelations  and  partial  autocorrelations  for  different 
levels  of  data  differencing.  These  autocorrelations  and  partial  autocor¬ 
relations  provide  an  Insight  in  selecting  p,  d,  and  q  of  the  ARIMA  model. 
To  determine  d,  one  looks  at  the  autocorrelations  for  a  given  level  of 

t 

differencing  and  observes  whether  or  not  they  “die  out"  rapidly.  If  they 
do,  the  given  level  of  differencing  Is  adequate;  If  not,  additional 
differencing  operations  are  required  until  this  constraint  Is  satisfied. 
The  smallest  level  of  differencing  for  which  the  autocorrelations  die  out 
rapidly  Is  taken  as  the  optimum  level  of  differencing,  d. 


To  determine  p  and  q  we  look  at  the  autocorrelations  and  partial  autocor¬ 
relations  for  the  selected  level  of  differencing.  Box  and  Jenkins 
summarize  this  approach  as  follows: 

"Briefly,  whereas  the  autocorrelation  function  of  an 
autoregressive  process  of  order  p  tails  off.  Its  partial 
autocorrelation  function  has  a  cutoff  after  lag  p. 

Conversely,  the  autocorrelation  function  of  a  moving  average 
process  of  order  q  has  a  cutoff  after  lag  q,  while  Its  partial 
autocorrelation  tails  off.  If  both  the  autocorrelations  and 
partial  autocorrelations  tall  off,  a  mixed  process  Is 
suggested.  Furthermore,  the  autocorrelation  function  for  a 
mixed  process,  containing  a  pth  order  autoregressive  component 
and  a  qth  order  moving  average  component.  Is  a  mixture  of 
exponentials  and  damped  sine  waves  after  the  first  q-p  lags. 
Conversely,  the  partial  autocorrelation  function  for  a  mixed 
process  Is  dominated  by  a  mixture  of  exponentials  and  damped 
sine  waves  after  the  first  p-q  lags." 

Once  p,  d,  and  q  are  selected,  we  proceed  to  the  second  stage  of  the  model 
Identification  process.  The  purpose  of  the  second  stage  Is  to  come  up  with 
Initial  estimates  of  the  autoregressive  and  moving  average  parameters. 
These  Initial  estimates  are  then  used  by  the  third  stage  of  the  model  In 
generating  final  estimates  of  the  autoregressive  parameters.  The  result  of 
this  three  stage  process  Is  a  feature  vector  consisting  of  a  small  number 
of  parameters  that  characterize  the  original  MES  time  series  data. 

Each  of  the  three  stages  of  the  ARIMA  model  Identification  process  were 
coded  and  tested  on  three  sets  of  sample  data  associated  with  Illustrative 
examples  In  Box  &  Jenkins.  After  appropriate  debugging,  we  were  able  to 
reproduce  the  values  for  autocorrelations,  partial  autocorrelations  and 


Intermediate  and  final  values  for  autoregressive  and  moving  average 
parameters  for  each  of  these  sample  data  sets.  A  detailed  description  of 
the  specific  algorithms  Implemented  Is  given  In  the  following  section. 

2.3.2  ARIMA  Software  Development.  As  there  was  no  ARIMA  software 
available  for  Immediate  Implementation  on  a  microcomputer,  we  decided  to 
write  our  own  ARINA  package.  We  decided  to  go  the  micro  rather  than 
minicomputer  route  for  three  main  reasons.  First,  we  wanted  a  dedicated 
system  In  a  laboratory  environment  where  we  could  collect  data  In  realtime, 
analyze  the  data  off-line  and  then  run  future  data  In  realtime  with 
realtime  recognition  software.  A  ml crocomputer  Implementation  allows  us 
this  flexibility.  Second,  the  portability  and  cost  factors  made 
microcomputers  an  attractive  proposition.  Finally,  we  had  both  language 
and  operating  system  of  choice  (C  and  UNIX)  available  on  the  microcomputer. 
In  developing  new  software,  one  always  has  to  face  the  problem  of  software 
program  validation.  In  order  to  do  this,  we  needed  both  detailed 
algorithms  and  test  data  that  had  been  generated  with  the  algorithms.  To 
this  end,  we  selected  Box  and  Jenkins'  Time  Series  Analysis  (1970).  This 
book  contains  detailed  algorithms,  trial  data  and  results.  Consequently, 
the  problem  became  one  of  writing  the  C-code  corresponding  to  these 
algorithms,  running  the  trial  data  through  the  various  stages  of  the  ARIMA 
model  Identification  process  and  comparing  the  results  generated  on  our 
microcomputer  Implementation  with  those  In  the  Box  and  Jenkins  example 
problem  solution. 

We  began  collecting  data  from  subjects  with  a  2  KHz  sampling  rate.  What  we 
found  however  Is  that  we  were  getting  ARIMA  models  with  an  extremely  large 
number  of  autoregressive  coefficients  before  cut-off,  after  some  reflec¬ 
tion,  we  decided  that  this  was  because  the  predominant  Information  was 
around  100  KHz.  This  meant  that  the  autocorrelations  and  the  partial 
autocorrelations  were  relatively  large  out  to  about  20  terms.  Since 


autoregressive  coefficients  are  closely  related  to  partial  autocorrelations 
we  would  need  a  model  with  around  20  autoregressive  terms  to  capture  all 
the  significant  autoregressive  coefficients. 


We  therefore  decided  that  we  were  oversampling  for  the  purpose  of  modelling 
the  predominant  Information  with  a  parsimonious  ARIMA  model.  We  thus  cut 
the  sampling  frequency  to  1  KHz  so  that  autocorrelations  and  partial 
autocorrelations  would  be  relatively  large  out  to  about  10  terms  only. 
This  gave  us  about  half  the  number  of  autoregressive  coefficients. 

2.3.3  ARIMA  Model  Implementation.  The  ARIMA  Model  Implementation  Is 
based  on  Box  &  Jenkins  (1970).  The  model  Is  Implemented  In  C  and  consists 
of  the  following  3  software  packages: 

(1)  PDQ  Estimator.  This  software  package  allows  the  experimenter 
to  estimate  the  number  of  levels  of  differencing  and  the 
number  of  autoregressive  and  moving  average  parameters  (1.e.» 
derive  p,  d,  and  q)  required  to  fit  the  data. 

(2)  INITARMA  Estimator.  This  software  package  provides  Initial 
estimates  of  autoregressive  and  moving  average  parameters. 

(3)  ARMA  Estimator.  This  software  package  provides  the  maximum 
likelihood  estimates  of  the  autoregressive  and  moving  average 
parameters. 

Each  software  package  Is  described  In  turn  In  the  following  sections. 

PDQ  Estimator 

The  user  employs  this  software  package  to  help  In  determining  the  number  of 
levels  of  differencing  (d),  the  number  of  autoregressive  parameters  (p), 
and  the  number  of  moving  average  parameters  (q)  required  to  model  a  given 
time  series.  This  package  produces  data  for  the  user,  which  the  user 
examines  to  select  p,  d,  &  q. 


Each  level  of  differencing  from  0  up  to  a  fixed  Integer  value  supplied  by 
the  user  is  computed  as  follows: 
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1  <  K  <  N, 

where  N  «  total  number  of  points  in  r-CX^}  and  {X^}  is  the  set  of  all  values 
in  the  time  series.  Subsequently,  a  zero  mean  transformation  is  applied  to 
the  time  series  by  setting  ■  xK  -  y,  where 


1  H 

M  -  IT  l  XK 
"  K»1  * 


The  resulting  zero  mean  time  series  is  used  In  all  subsequent  computations. 
First,  the  autocovariances  (CR)  up  to  a  specified  lag  are  computed  by: 


x  N-K 

CK  "  2  *Wt  *  Mt+K} 


Then,  the  autocorrelations  (rK)  are  computed  by: 


The  standard  errors  of  autocorrelations  (o^)  are  computed  by: 


oK  -  (Wi  ♦  2  (  1  n ) )/ (vTT  ) 
*  1  1»1  1 


Similarly,  partial  autocorrelations  are  computed  using  the  Iterative 
formula  given  below: 


The  user  must  evaluate  the  autocorrelations  and  partial  autocorrelations  at 
each  level  of  differencing  and  decide  on  p,  d,  and  q.  For  the  evaluation 
criteria  needed  to  make  these  decisions,  consult  Chapter  6  of  Time  Series 
Analysis  (Box  and  Jenkins,  1970). 


1NITARMA  Estimator.  This  software  package  Is  used  to  compute  Initial 
estimates  of  the  autoregressive  (♦)  and  the  moving  average  (i)  parameters. 
It  Is  fully  automated,  and  when  given  a  p,  d,  and  q  as  an  Input,  will 
provide  Initial  estimates  of  the  autoregressive  parameters,  $  ,  and  the 
moving  average  parameters,  e.  The  original  time  series  Is  differenced  d 
times  and  then  made  zero  mean  and  the  autocovariances  (CK)  are  computed  as 
before. 


The  autoregressive  parameters  are  computed  by  solving  the  Yule-Walker 
equations  as  given  below: 


A$0  »  x  where  •  C|q+1_j| ,  X1  «  Cq+1  for  1,  j  «  1,  2,  ...  | 


Subsequently*  modified  covariances  are  calculated  by: 


The  Newton-Raphson  algorithm  Is  then  employed  to  calculate  Initial 
estimates  for  moving-average  values  using  the  recursion  relation: 


where  T*h  =  f* 


In  simple  terms,  the  value  of  t *+1  Is  calculated  at  the  (1+l)st  Iteration 
from  Its  value  t*  at  the  1th  iteration,  where 


(t0,  t1#  ...»  Tq),  fj  *  1|0T1T1+J"CJ*  f  =  •••»  fg)* 
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ARMA  Estimator.  This  software  package  Is  used  to  compute  the  maximum 
likelihood  estimates  for  $  and  i.  The  Initial  estimates  of  the 
autoregressl ve  parameters,  i,  and  moving  average  parameters,  e,  are 
supplied  by  the  user  along  with  the  differenced,  zero-mean  time  series. 

The  maximum  likelihood  estimates  for  $  and  e  are  obtained  using  the 
Narquardt  Algorithm  for  Nonlinear  Least  Squares  as  modified  by  6.  Wilson. 
Until  such  time  that  convergence  has  not  been  achieved,  the  following 
sequence  of  steps  are  repeatedly  performed: 

(1)  Conditional  residuals  are  calculated  from  current  estimates 
of  ♦  and  i. 

(2)  The  sum  squared  of  the  residuals  Is  calculated. 

(3)  The  partial  derivatives  of  the  residuals  as  a  function  of 
changes  In  4  and  i  are  computed. 

(4)  The  covariance  matrix  of  the  current  estimates  Is  computed 
along  with  a  vector  based  on  the  partial  derivatives  and  the 
residuals  and  a  vector  of  scaling  quantities. 

(5)  New  estimates  of  $  and  e  are  made. 

Each  step  Is  discussed  In  detail  below: 

Calculating  Conditional  Residuals 

The  conditional  residuals  are  easier  to  compute  than  the  unconditional 
residuals  which  Involve  backforecastlng  the  time  series.  These  conditional 
residuals  are  computed  according  to  the  following  formula: 
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where  M  »  m1n(1-l,q),  for  1  -  1,2, ...,N. 
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Calculating  the  Sum  Squared  of  the  residuals 


The  sum  squared  of  the  residuals  Is  calculated  by: 


Calculating  Partial  Derivatives  of  the  Residuals 

Let  B  *  (B1#  Bg,  •••\)  *  (*1»*2*  •••  *p»el»e2»  *•*»  eq)'  Then 
partial  derivatives  of  the  residuals  Is  calculated  by 

^  ^  {  at  (Bj»  •••»  B ^ »  •••»  B g)  *  at  (Bj»  •  •  • »  B  ^  • 

where  t  *  1,  2,  ....  N. 

Stage  1:  Calculating  Covariance  Matrix  of  Current  Estimates.  Etc. 


I 


The  vector  based  on  the  partial  derivatives  and  residuals  Is  computed  via: 


The  vector  of  scaling  quantities  Is  calculated  by: 


The  modified  and  constrained  linearized  equations  A*  h*  «  g*  are 
constructed  according  to: 


The  equations  are  solved  for  h*,  which  is  scaled  back  to  give  the  parameter 
corrections  h^,  where 


i  L 
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Then  the  new  parameter  values  are  constructed  from 


g 


r 


I 


e  -  6q  +  h 


and  the  sum-square  of  residuals  S(B)  evaluated. 

Stage  3: 

(1)  If  S(8 )  <  S(8q),  the  parameter  corrections  h  are  tested.  If 
all  are  smaller  than  e,  convergence  Is  assumed  and  the  KxK 
matrix  A”1  Is  used  to  calculate  the  covariance  matrix  of 
estimates  as  described  below;  otherwise,  B  Q  iS  reset  to  the 
value  8,  »  Is  reduced  by  a  factor  F2  and  computation  returns 
to  Stage  (1). 

(2)  If  $(e)  >  S(bq),  the  constraint  parameter  vis  Increased  by  a 
factor  F2  and  computation  resumed  at  Stage  (2).  In  all  but 
exceptional  cases,  a  reduced  sum  of  squares  will  eventually  be 
found.  However,  an  upper  bound  Is  placed  on  ir,  and  If  this 
bound  Is  exceeded,  the  search  Is  terminated. 

When  convergence  Is  achieved,  either  according  to  the  criterion  In  (1)  of 
Stage  3,  or  It  Is  assumed  to  have  occurred  after  a  specified  number  of 
Iterations,  the  residual  variance  and  the  covariance  matrix  of  the 
estimates  are  computed  as  follows. 

After  the  maximum  likelihood  estimates  are  computed,  specific  computations 
providing  some  Indication  about  the  goodness  of  the  estimates  are  made. 
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First,  the  residual  variance  Is  calculated  by: 


Then,  the  covariance  matrix  of  estimates  Is  calculated  by: 


where 


N-k 


:aa(K)  ^  <at-i)(at«-5>’  where 
.  N 

1  8  j  I  ®t» 

"  t=l  1 


and 


K  -  0,  1 . (N/10)  +  p  +  q. 


Finally,  the  chi-square  statistic  and  degrees -of -freedom  are  calculated  by: 


2.3.4  Control  of  Data  Analysis.  Originally,  a  package  was  written  to 
control  the  analysis  of  the  collected  MES  data.  This  package  allowed  us  to 
serially  analyze  MES  records  on  a  disk  file  In  an  interactive  fashion. 
Since  the  data  for  one  experimental  session  Is  contained  In  a  single  file 
with  several  MES  records,  this  required  that  the  experimenter  be  present  to 
process  each  record  for  the  experimental  sessions  with  which  he  was 
concerned.  Consequently,  a  batch  mode  package  was  written  allowing  the 
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experimenter  to  specify  up  to  25  files  representing  25  experimental 
sessions  and  process  all  the  records  in  these  files.  This  program  can 
either  be  used  to  Identify  the  order  of  the  ARIMA  model  (l.e.,  find  p,  d,  A 
q)  or  to  get  the  preliminary  and  final  estimates  of  the  autoregressive  and 
moving  average  parameters. 

This  batch  program  Is  particularly  useful  because  at  the  present  time  since 
we  do  not  currently  have  hardware  tled-in  to  the  Motorola  68000  to  perform 
floating-point  operations,  ARIMA  process  execution  takes  several  hours. 
This  way  we  can  leave  the  system  running  overnight  and  process  the  results 
of  many  experimental  sessions  with  no  operator  Intervention  required. 

2.3.5  Analog-to-Dlqltal  Driver  Program.  In  order  to  “communicate"  with 
the  A/D  board  through  a  program  running  under  UNIX,  It  was  necessary  for  us 
to  develop  a  device  driver  and  add  It  to  the  drivers  In  the  prior  UNIX 
configuration.  The  kernel  of  the  operating  system  consists  of  a  scheduler 
which  Is  periodically  Invoked  by  a  hardware  interrupt  to  determine  whether 
or  not  to  parcel  out  time  to  any  on-going  activity .  The  UNIX  kernel  is 
Invoked  every  ID  msec,  and  executes  for  approximately  1.0  msec.  Since  the 
Interrupt  rate  of  the  A/D  board  was  over  2kHz,  we  had  to  Interrupt  the  UNIX 
kernel.  Since  the  kernel  disables  all  maskable  Interrupts,  the  only  way  to 
do  this  Is  to  use  an  Interrupt  channel  that  can't  be  locked  out  —  namely 
the  nonmaskable  Interrupt. 

A  driver  program  for  a  peripheral  device  usually  consists  of  various 
functions  which  can  be  executed  at  a  normal  rate  and  an  interrupt  handler 
which  must  be  invoked  Immediately  after  an  interrupt  is  received  and 
executed  quickly  without  Interruption.  Since  the  interrupt  Itself  was 
given  top  priority  (l.e.  -  It  was  non-maskable)  we  were  guaranteed  that  the 
Interrupt  handler  would  be  Invoked  limtedlately;  however,  the  interrupt 
handler  had  to  be  streamlined  to  execute  very  fast.  Thus,  this  handler  was 
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written  In  68000  assembly  language.  This  allowed  some  time  during  the 
approximately  500  sec.  between  Interrupts  for  background  UNIX  procedures 
and  data  collection  software  processing. 

2.3.6  Development  of  Data  Collection  Package.  In  order  to  perform 
offline  ARIMA  analysis  of  MES  data,  the  data  must  be  collected  and  stored 
during  the  performance  of  the  experiment.  To  this  end,  a  data  collection 
package  was  developed.  This  package  allows  the  experimenter  to  select  the 
particular  experiment,  level  of  difficulty,  and  trial.  It  also  allows  the 
experimenter  to  specify  the  A/D  channels  Involved  and  the  data  files  to  be 
used  for  MES  data  storage. 

When  the  actual  experiment  begins,  this  software  sends  a  code  from  the 
Motorola  68000  through  an  RS232  Interface  to  the  Apple  lie  In  order  to 
Initiate  the  appropriate  experiment.  At  specified  Intervals,  data  Is  then 
collected  through  the  electrodes  attached  to  the  subject,  via  the  A/D,  and 
stored  In  the  experimenter-specified  file.  After  a  predetermined  time  has 
elapsed,  a  message  Is  sent  to  the  Apple  lie  to  terminate  the  experiment. 
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3.  EXPERIMENTAL  STUDY 


3.1  Overview 


The  first  series  of  experiments  was  designed  to  assess  the  “goodness"  of 
model -derived  features  In  terms  of  their  relevance  to  operator  alert¬ 
ness/workload  levels.  The  main  vehicle  used  for  this  Is  a  computer-based 
stochastic  signal  processing  and  pattern  recognition  algorithm.  In 
previous  sections  we  have  described  how  a  stochastic  modeling  approach 
characterizes  a  myoelectric  signal.  In  this  section  we  will  describe  the 
model  function  validation  methods  and  the  specific  behavioral  Issues  being 
Investigated  via  the  use  of  model -based  feature  derivation/extraction  of 
workload  correlates.  A  task  simulation  configured  to  resemble  the 
Criterion  Task  Set  (CTS)  workload  test  battery  developed  at  AFAMRL 
(Shlngledecker,  1983)  was  developed.  Each  subject  was  presented  with 
controlled  workload  tasks  along  the  perceptual /central  processing/motor 
task  dimensions.  As  the  subject  performed  the  various  tasks,  the  MES  was 
recorded  at  the  beginning,  the  middle  and  near  the  end  of  task  execution. 
At  the  end  of  the  experiment,  model  outputs  and  subject  performance  and 
rating  comparisons  were  made  between  levels  of  task  loading  and  among 
various  types  of  tasks. 

3.2  Experimental  Hypotheses  and  Test  Procedure 

In  this  Initial  set  of  experiments,  the  fundamental  question,  l.e.  whether 
task  loading  affects  model-derived  MES  features  In  some  deterministic 
fashion,  was  examined.  To  this  end,  three  basic  Issues  were  Investigated. 
The  first  concern  Is  whether  It  Is  possible  to  find  at  least  one  ARIMA 
model  coefficient  that  has  a  near-constant  magnitude  for  each  underlying 
loading/alertness  level  for  a  given  subject,  muscle  site,  and  task  type. 
To  this  end,  the  model  coefficients  were  examined  for  Invariance  across 


multiple  samples  within  trials  and  across  multiple  trials.  Those 
coefficients  that  satisfy  the  above  conditions  are  considered  "reliable." 
The  second  key  Issue  l.e.  whether  the  features  that  were  considered 
reliable  are  also  sufficiently  different  In  magnitude  for  each  of  the 
different  levels  of  task  demand  and  for  each  task  category.  To  this  end, 
the  features  are  examined  across  the  different  task  types  and  levels  of 
task  demands.  The  third  central  issue  addressed  Is  the  correlation  and 
sensitivity  of  these  features  to  primary  task  performance  and  subjective 
ratings. 

Our  two  key  hypotheses  associated  with  ARIMA  stochastic  model  character¬ 
ization  of  MES  are  that  we  can  potentially  uncover  both  reliable  and 
diagnostic  features  associated  with  the  MES  on  the  basis  of  which  we  will 
be  able  to  Infer  the  underlying  operator  state/load. 

By  feature  reliability,  we  mean  that  there  Is  at  least  one  set  of  model 
coefficients  In  the  ARIMA  model  that  provides  Invariant  or  near-invariant 
pattern  values  for  each  subject  within  each  underlying  level  of 
alertness/mental  load  for  a  given  type  of  task. 

By  feature  dlagnostlclty,  we  mean  that  each  of  these  reliable  (Invariant  or 
near-invariant)  pattern  elements  is  distinctly  different  (In  a  statistical 
sense)  for  the  different  levels  of  task  demand  and  possibly,  for  different 
types  of  tasks.  Candidate  features  are  selected  from  the  overall  pattern 
vector  to  test  the  hypotheses. 

Hypothesis  Testing.  In  the  search  for  reliable  features,  we  ran 
preliminary  test  experiments  using  one  subject  with  repeated  runs.  Feature 
reliability  and  dlagnoslty  were  then  established  In  a  formal  experiment 
using  a  repeated  measures  design.  A  number  of  pattern  recognition 
approaches  to  data  analysis  can  be  used  to  test  the  significance  of  both 
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reliability  and  dlagnostlclty  of  selected  features.  These  Include  t-test 
for  comparison  of  group  means.  Analysis  of  Variance  and  chi-square  tests 
for  comparison  of  variable  subgroups  and  partial  correlation  and  clustering 
of  data. 

3.3  Experimental  Tasks.  The  central  concept  of  this  study  Is  to  Impose 
controlled  workload  tasks  while  simultaneously  recording  MES  signals  from 
selected  muscle  slte(s).  The  selection  of  tasks  and  procedures  was  based 
on  the  degree  to  which  they  satisfy  the  requirements  of:  (1)  validity  and 
reliability,  (2)  flexibility  and  quantlf lability,  (3)  memory,  (4)  mental 
mathematics/reasoning,  and  (5)  choice  reaction  time.  This  set  constitutes 
the  most  frequently  used  criteria  In  the  literature.  It  also  represents  a 
subset  of  standardized  loading  tasks  under  development  at  AFAMRL.  The 
overall  criteria  task  set  (CTS)  under  development  at  AFAMRL  Include  the 
following  (note  that  the  CTS  Is  a  combination  of  discrete.  Independent  task 
components  rather  than  an  Integrated,  continuous  game  situation  such  as 
Perceptronlcs'  earlier  simulation  of  a  supervisory  air  piloting  task): 


(1)  Perceptual  tasks. 

•  Probability  monitoring  task 

•  Auditory  monitoring  task 
e  visual  target  search  task 

(2)  Central  processing  tasks. 


Memory  tasks  -  memory  update,  memory  recall. 

Manipulation  and  comparison  tasks  -  linguistic  processing, 
mathematical  computation,  spatial  pattern  Identification. 
Reasoning  tasks  -  analogical  reasoning  and  grammatical. 
Planning  and  scheduling  -  flight  assessment  and 
supervisory  control. 
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(3)  Motor  tasks 


t  Critical  tracking  task. 

For  the  MES  feature  selection  study  performed  In  the  first  phase  of  our 
program,  we  employed  a  subset  of  the  CTS,  selecting  only  those  task 
components  that  were  already  established  and  validated  at  AMRL.  These 
components  Included  a  probability  monitoring  task,  critical  tracking  task, 
and  manipulation  and  comparison  task.  These  task  elements  are  described  In 
the  following  paragraphs. 

(a)  Probability  Monitoring  Task  Is  the  monitoring  of  dynamic  processes 
represented  as  contl nously  moving  Indicators.  The  operator  Is  concerned 
with  whether  or  not  the  fluctuating  process  or  condition  Is  maintained 
within  prescribed  limits,  or  a  prescribed  average  value.  A  typical  example 
In  an  aircraft  Is  the  requirements  to  monitor  the  rate  of  climb  Indicator 
In  rough  air.  The  operator  observes,  on  a  sampling  basis,  the  moment  to 
moment  fluctuations  In  the  position  of  the  pointer.  The  primary  Interest 
of  the  operator  response  Is  the  perceptual  recognition  of  the  occurrence  of 
a  change  In  the  average  value  of  the  fluctuating  pointer.  Thus,  In 
addition  to  assessing  a  monitoring  function,  the  evaluation  of  stimulus 
discrimination  Is  also  Involved. 

The  basic  display  elements  (see  Figure  3-1)  were  a  number  of  scales 
programmed  so  that  the  pointer  fluctuated  in  random  manner  about  specified 
average  values.  The  maximum  frequencies  represented  In  the  fluctuation  of 
the  pointer  were  somewhat  less  than  1Hz.  The  program  also  allowed  for  the 
selection  of  negative  or  positive  "bias"  by  the  operator  using  a  two-point 
switch.  Thus,  If  the  operator  suspected  that  the  average  value  had 
departed  from  the  norm,  he  could  use  the  switch  and  got  Immediate  feedback 
as  to  the  correctness  of  his  judgment.  Feedback  was  presented  as  a  stopped 


FIGURE  3-1. 

PROBABILITY  MONITORING 


pointer  showing  true  bias  and  the  pointer  would  move  back  to  unbiased 
position  If  his  judgment  was  correct.  The  manipulation  dimensions  Included 
the  number  of  dials  and  the  magnitude  of  the  bias  (as  S/N). 

(b)  Critical  tracking  task  Is  a  time-honored  testing  procedure  that  keeps 
making  a  test  more  difficult  until  the  operator  falls  to  control  the 
unstable  process.  The  level  of  the  test  at  the  failure  point  Is  used  to 
define  the  operator's  ability  to  keep  the  system  stable  by  carefully 
adjusting  his  own  control  gain.  Unlike  the  critical  tracking  task  system 
used  at  AMRL  which  Is  "hard-wired",  we  Implemented  simulated  task 
conditions  In  software,  representing  the  system  dynamics  via  a  set  offlrst 
order  differential  equations.  The  standard  critical  tracking  task 
Implemented  Is  described  In  Figure  3-2.  The  autopacer  system  automatically 
decreases  the  stability  margin  monotonlcally  from  an  Initial  confortable 
level.  The  rate  of  decrease  automatically  slows  down  as  the  smoothed 
absolute  control  error  Increases.  When  the  task  becomes  so  difficult  that 
control  Is  lost,  the  value  of  the  stability  margin  Is  recorded.  The  task 
Is  simply  represented  on  the  screen:  the  tracked  symbol  moved  dynamically 
away  from  the  center  of  the  screen,  while  the  center  and,  the  range  of  the 
allowable  path  are  shown  as  the  background.  The  manipulation  dimensions 
Includes  Instability  level  and  the  number  of  the  tracking  axis. 

(c)  Manipulation  and  comparison  task.  The  specific  task  developed  under 
the  category  Is  a  linguistic  processing  task  that  requires  subjects  to 
classify  paired  stimuli  (letters,  digits,  words  or  forms)  and  to  press  one 
of  two  keys  (same  or  different).  The  level  of  Instruction  upon  which  the 
subject  was  to  base  his  classification  is  varied.  The  instructions  used  to 
define  "same"  are  physical  Identity  (e.g.,  AA),  name  Identity  (e.g.,  Aa), 
category  Identity  (e.g.,  Ae),  rhyme  (Arrange-Exchange),  synonym  (Ally- 
Friend)  and  antonym  (Truce-Conflict).  The  experiments  are  designed  to 
allow  the  same  stimulus-response  combination  (e.g.,  AB-dlfferent)  to  occur 
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with  Instructions  at  quite  different  levels.  These  Instructions  are  stored 
In  the  computer  and  retrieved  before  the  onset  of  the  paired  stimulus.  The 
manipulation  dimensions  are  the  dominant  Instruction  level  and  the  type  and 
population  of  stimuli. 

3.4  Experimental  Variables.  The  experimental  hypotheses  deal  with  the 
statistics  of  MES  feature  values,  task  performance  measures  (reaction  time, 
and  performance  accuracy)  and  rating  scales.  The  following  experimental 
variables  and  levels  were  tested: 

(1)  Task  type  -  three  levels. 

(a)  Perceptual  tasks. 

(b)  Central  processing  tasks. 

(c)  Tracking  tasks. 

(2)  Task  loading  level  -  two  levels. 

(a)  Low. 

(b)  High. 

The  low  and  high  loading  levels  were  adjusted  according  to  the  level,  and 
values  given  to  AMRL's  CTS  Implementation.  The  low  loading  levels  seem  to 
provide  sufficient  time  for  the  subject's  response,  while  the  high  loading 
level  Is  designed  to  somewhat  stress  the  subject's  performance,  but  not  to 
debilitate  the  subject's  response  accuracy. 
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3.5 


Muscle  Site  Selection 


Because  floating-point  hardware  for  the  68000  Is  only  now  becoming 
available,  we  were  restricted  to  a  single  muscle  site  If  we  wished  to  keep 
the  processing  time  down  to  a  manageable  level  for  this  first-phase 
Investigation.  It  was  therefore  necessary  to  ascertain  which  muscle  would 
provide  the  most  reliable  signal  for  ARIMA  modelling.  A  preliminary  set  of 
experiments  was  run  on  a  single  subject  while  data  was  collected  from  four 
sites  :  Splenius,  trapezius  and  forearm  flexor  and  extensor.  After 
subjecting  the  collected  myoelectric  signals  to  the  ARIMA  modelling 
procedure,  we  found  that  the  signals  collected  from  the  trapezius  muscle 
were  the  most  reliable  (l.e.,  they  produced  the  most  repeatable  AR 
coefficients).  We  therefore  decided  to  conduct  this  first-phase  experiment 
using  the  trapezius  muscle. 

3.6  Subjects  and  Procedures 

An  experiment  based  on  the  representation  described  above  was  conducted. 
Initially,  a  single  subject  participated  In  a  preliminary  experiment 
designed  to:  (1)  evaluate  plausible  model  order  and  features,  and  (2) 
adjust  the  task  parameters.  Subsequently,  three  male  subjects  were 
recruited  from  universities  and  within  Perceptronlcs*  subject  pool.  All 
subjects  represented  the  type  of  personnel  who  might  Interface  well  with 
perceptual,  central  processing  and  tracking  tasks.  Subject  ages  ranged 
from  18  to  30.  All  had  at  least  a  high  school  diploma  and  some  experience 
with  computers.  The  subjects  were  assigned  randomly  to  each  of  three 
groups.  The  subjects  were  paid  $5.50  per  hour  and  were  given  a  bonus  of  up 
to  $5.50  per  hour  contingent  on  performance.  The  first  three  subjects,  one 
from  each  group,  had  completed  the  formal  experiment  In  all  nine  task 
situations  In  a  balanced  order. 
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The  following  procedure  was  followed.  Each  subject  was  asked  to  read  an 
Instruction  sheet  (Appendix  B)  explaining  the  experiments  to  be  performed 
by  him.  Subjects  were  encouraged  to  ask  questions  as  they  read  the 
Instruction  sheet.  The  subject  was  then  asked  to  read  and  fill  out  a 
"personal  Information  fact  sheet”  and  a  "consent  to  act  as  an  experimental 
subject"  form.  Next,  the  active  electrode  assembly  was  attached  to  the 
subject's  upper  back  running  approximately  parallel  to  the  muscle  fibers. 

A  secondary  ground  electrode  was  placed  on  the  medial  eplcondyle  of  the 
subject's  humerus.  Both  electrodes  were  placed  on  the  subject's  non- 
dominant  side.  Next,  the  subject  underwent  an  orientation  and  practice 
session  lasting  approximately  2  hours.  This  was  done  to  reduce  the  effects 
of  learning  during  the  performance  of  the  actual  experiment.  The  practice 
session  was  concluded  when  the  subject  produced  comparable  scores  on  two 
successive  trials  for  each  task.  After  a  15  minute  break,  the  actual 
experiment  was  performed.  The  subject  was  Instructed  to  sit  comfortably 
upright  In  the  chair.  The  subject  was  cautioned  against  moving  the  side  of 
his  body  holding  the  electrodes.  For  each  of  three  sittings,  the  subject 
was  required  to  perform  two  different  tasks,  each  at  two  different  levels 
of  difficulty.  The  subject  was  given  a  two-minute  refresher  session  just 
prior  to  performing  a  particular  task.  At  this  time,  a  sampled  time  series 
Is  displayed  graphically  on  the  screen  In  order  to  check  signal  Integrity. 
Upon  task  completion,  the  subject  was  asked  to  fill  out  a  questionnaire  In 
which  he  supplied  subjective  ratings  and  post-experimental  comments.  After 
completing  this  form,  the  subject  was  Instructed  to  take  a  15  minute  rest 
before  proceeding  to  the  next  task. 

Each  experimental  session  consisted  of  two  200-second  trials.  Each  subject 
took  two  days  to  complete  both  the  orientation  session  and  the  six 
experimental  sessions.  During  each  trial,  data  sampled  at  1  KHz  was 
collected  In  each  of  three  250  msec  windows  spaced  60  seconds  apart  over 
the  200  second  trial.  This  data  collection  scheme  allowed  us  to  evaluate 
feature  reliability  both  within  and  between  trials. 
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Performance  Measures 


The  performance  measures  that  were  collected  in  the  experimental  trials 
are: 


(1)  Response  Time  -  subject's  response  measured  from  the  onset  of 
stimulus  to  the  Instant  when  an  action  Is  initiated. 

(2)  Response  Accuracy  -  response  errors  or  Incorrect  actions  as 
represented  by  the  number  of  Incorrect  "key  presses,"  false 
alarms,  missed  events;  or  response  precision  measures  such  as 
RMS  tracking  error. 

These  measures  were  obtained  by  after  analyzing  both  the  sampled  and 
cumulative  data.  With  the  exception  of  RMS  tracking  error  data,  which  were 
sampled  four  times  per  second,  all  data  were  sampled  asynchronously.  The 
empirical  results  along  with  the  statistical  and  pattern  analyses  are 
discussed  In  the  following  section. 


4.  PRELIMINARY  EXPERIMENTAL  RESULTS  AND  DISCUSSION 


4.1  Overview 


This  chapter  summarizes  the  preliminary  results  of  the  experiments  performed 
In  the  current  phase  of  this  program.  The  experimental  tasks  were 
sufficiently  varied  to  provide  a  reasonable  test  of  both  repeatability  and 
dlagnostlclty  of  model -derived  features.  In  our  experience  thus  far,  we 
found  that  the  model  parameters  converged  rapidly.  Our  preliminary 
analysis  revealed  that  the  first  autoregressive  coefficient  of  the  model 
shows  a  high  degree  of  repeatability  for  all  subjects  under  all  test 
conditions.  The  dlagnostlclty  of  this  feature,  however  Is  yet  to  be 
established. 

The  MES  data,  collected  during  the  experimental  trials  and  the  model 
parameters  "fitted"  during  off-line  Identification  are  being  examined 
closely  using  detailed  statistical  and  pattern  analysis  methods.  The 
subject's  performance  data,  subjective  ratings  and  comments  related  to  the 
various  task  situations  will  be  evaluated  In  terms  of  possible  correlation 
with  the  selected  MES  features. 

4.2  Preliminary  MES  Features  Results 

In  the  following  paragraphs,  the  results  and  preliminary  findings  of  the 
first  phase  effort  are  discussed.  The  initial  experiments  consisted  of 
three  subjects,  each  performing  two  trials  of  three  different  tasks  at  two 
levels  of  difficulty.  Analysis  of  the  actual  MES  data  collected  during  the 
experiments  showed  that  differencing  was  not  required  (l.e.,  d=0) 
Indicating  that  In  at  least  this  case,  the  signal  is  stationary.  We 


further  found  that  In  all  cases  the  autocorrelation  function  was  that  of  a 
damped  sinusoid  or  decaying  exponential  Indicating  that  no  moving  average 
terms  (l.e.,  q*0)  are  necessary  to  model  the  signal.  We  therefore  conclude 
that  given  our  sampling  rate  of  1  KHz  and  sampling  window  size  of  250  msec, 
the  process  Is  purely  autoregress  of  order  “p."  Correlation  analysis  thus 
far  revealed  that  the  first  AR  term  is  In  certain  cases  Is  strongly  coupled 
to  the  level  of  task  difficulty.  Specifically,  the  first  AR  coefficient 
for  a  particular  subject,  task,  level  of  difficulty  and  trial;  Is 
relatively  constant  for  the  three  records  taken  during  each  of  the  three 
data  collection  analysis  “windows"  during  the  course  of  the  trial.  This  Is 
a  pervasive  finding  for  all  subjects,  tasks  and  levels  of  difficulty 
studied.  On  the  basis  of  these  preliminary  findings  It  appears  that  the 
first  AR  coefficient  Is  a  good  candidate  for  becoming  a  "feature"  because 
It  1$  repeatable,  l.e..  It  remains  fairly  constant  for  the  mental  category 
and  the  duration  of  the  specific  task  over  which  the  signal  Is  recorded. 
On  the  debit  side,  while  It  Is  true  that  this  parameter  Is  constant  for  a 
particular  task,  trial  and  load;  the  absolute  value  of  the  parameter  does 
vary  from  day  to  day.  Vie  feel  this  variation  In  the  MES  from  day  to  day  Is 
because  the  subject's  emotional  state  may  be  different  on  any  given  day 
giving  rise  to  different  levels  of  muscle  tension.  In  addition. 
Imprecision  In  electrode  placement  and  variations  In  the  electrode>sk1n 
Interface  are  difficult  to  control  over  extended  periods  of  time.  Since  we 
are  more  interested  In  the  relative  values  of  the  parameter  of  Interest 
over  the  course  of  a  trial  than  we  are  the  absolute  value  from  trial  to 
trial  and  task  to  task,  we  check  to  see  If  the  relative  values  follow  the 
same  trend  from  trial  to  trial  and  task  to  task.  In  almost  all  cases  the 
value  of  the  first  AR  coefficient  associated  with  the  third  recording 
window  decreases  with  an  Increase  In  task  difficulty.  We  choose  the  last 
record  based  on  our  assumption  that  most  transient  effects  have  stabilized 
by  that  point  In  the  trial.  We  feel  that  this  decrease  in  the  value  of  the 
coefficient  Is  correlated  with  an  Increase  In  muscle  tension  which  Is 
expected  to  occur  with  an  Increase  In  task  difficulty.  Upon  looking  at  the 


curves  of  the  first  AR  coefficient  vs  level  of  difficulty  for  the  first 
subject  (Figure  4-1)  It  can  be  seen  that  for  one  particular  trial  and  task 
(trial  two  of  the  motor  response  task),  the  slope  of  the  curve  is  much 
steeper  than  for  the  other  trials  and  tasks.  In  keeping  with  our 
hypothesis  that  a  decrease  In  AR  coefficient  Is  associated  with  an  increase 
In  the  subjective  experience  of  mental  workload,  we  put  forward  a  plausible 
argument  that  In  this  Instance  the  subject  must  have  experienced  a  more 
substantial  Increase  In  workload  Is  going  from  the  low  to  the  high  level  of 
difficulty  than  he  did  for  the  other  tasks  and  trials.  Upon  checking  the 
subject's  performance  results,  we  observed  that  this  high  level  of  workload 
was  not  accompanied  by  a  drop,  but  rather  an  unexpected  Increase  In 
performance.  We  found  corroboration  of  both  our  hypotheses  and  explanation 
of  this  performance  upon  reviewing  the  subject's  answers  and  comments  on 
the  post -experiment  questionnaire.  His  comment  read: 

"The  higher  level  of  concentration  required  with  this  test 
enables  me  to  keep  cursor  closer  to  the  center  more  of  the 
time." 

In  terms  of  our  hypothesis,  this  translates  to  the  fact  that  his  workload 
was  Indeed  higher  requiring  greater  concentration  to  do  the  task  well.  The 
subject  did  provide  this  extra  concentration  thereby  not  just  maintaining 
but  actually  Increasing  his  performance.  This  can  be  seen  by  his  specific 
mention  of  the  "higher  level  of  concentration  required"  which  explains  the 
large  drop  In  the  value  of  the  AR  coefficient  and  his  statement  that  "this 
enabled  him  to  keep  the  cursor  close  to  the  center"  which  explains  the  good 
performance  results. 

This  same  trend  of  a  decrease  In  the  first  AR  coefficient  with  an  Increase 
In  task  difficulty  shows  up  In  the  data  of  the  third  subject  also  (Figure 
4-2).  Unfortunately  this  finding  was  not  as  pervasive  among  the  second 
subject  tested  (Figure  4-3).  While  this  subject  showed  the  same  downward 
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trend  for  the  motor  response  task,  the  coefficient  of  Interest  Increases 
with  an  Increase  In  task  difficulty  for  the  perceptual  and  cognitive 
processing  tasks.  We  put  forward  the  plausible  explanation  that  different 
people  handle  Increases  In  workload  In  different  ways.  Some  people  deal 
with  an  Increase  In  task  load  with  a  corresponding  Increase  In  vigilance 
which  In  turn  causes  subconscious  Increase  In  muscle  tension;  others 
respond  to  Increased  load  by  'task  shedding',  that  is  they  reduce  the  task 
to  one  of  manageable  workload  by  selectively  Ignoring  events  that  would 
raise  the  workload  past  the  level  that  they  feel  comfortable  with.  In 
Instances  like  this  It  Is  difficult  to  correlate  task  load  to  muscle 
tension  because  the  applied  task  related  load  Is  different  from  the  load 
actually  perceived  by  the  subject.  In  this  case  the  first  AR  coefficient 
that  we  are  using  as  a  dependent  variable  Is  not  a  good  Indicator  of  task 
difficulty  but  rather  perhaps  an  indication  of  the  level  of  vigilance 
exhibited  by  the  subject  In  responding  to  the  taskl 

4.3  Task  Performance  and  Subjective  Ratings 

Figures  4-4,  4-5,  and  4-6  show  the  task  performance  scores  attained  for  the 
three  subjects  under  six  different  task  conditions.  It  appears  that  exper¬ 
imental  variables  generally  produced  significant  effects  on  performance 
time,  l.e.,  the  subjects'  response-time  and  errors  significantly  Increased 
as  the  difficulty  level  Increased  from  low  to  high.  The  effects  are  more 
pronounced  In  the  central  processing  tasks  and  perceptual  task,  than  that 
in  the  tracking  control  tasks.  These  effects  are  confirmed  by  subjective 
ratings  of  task  difficulty  which  show  consistent  Increase  with  assigned 
difficulty  level.  Subject  comments  and  ratings  concerning  the  perceived 
level  of  effort  In  performing  the  tasks  were  also  analyzed  along  with  the 
perceived  level  of  difficulty  (Table  4-1).  Although,  the  subjects  In 
general  perceived  themselves  as  assigning  greater  effort/attention  with 
Increase  In  task  difficulty  In  order  to  maintain  adequate  performance, 
there  Is  evidence  of  "task  shedding"  among  the  low-score  sessions.  In  which 
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the  subjects  have  demonstrated  a  lower  expenditure  of  effort  for  more 
difficult  tasks.  This  "task  shedding1*  phenomenon  has.  In  certain  cases, 
distorted  task  loading  effects,  and.  In  a  few  extreme  cases,  has  actually 
reversed  the  trend  of  the  actual  loading  level.  When  this  reversal  occurs, 
mixed  trends  In  the  MES  feature  become  apparent. 

In  order  to  assess  If  any  statistically  significant  correlation  exists 
among  taskloading,  motivation /effort  level  and  MES  features,  detailed 
statistical  and  pattern  analysis  must  be  performed. 

4.4  Discussions 

These  preliminary  results  Indicate  that  the  first  autoregressive  parameter 
Is  by  far  the  most  useful  feature  In  differentiating  workload/alertness 
level.  The  data  has  established  this  feature's  repeatability.  Its 
dlagnostlclty  may  be  readily  demonstrated  In  the  near  future  with  a  more 
refined  experiment  that  the  one  initially  performed. 

The  overall  system  approach  In  the  use  of  ARIMA  model -based  analysis  on 
non-dominant  MES  signals  has  proved  to  be  both  technically  and 
operationally  feasible,  and  shows  promise  for  pilot  workload/alertness 
level  assessments. 

For  the  next  phase  of  this  Investigation,  there  are  several  hardware  and 
software  changes  that  we  are  contemplating  which  will  give  us  more 
flexibility  and  allow  us  to  more  precisely  "tune"  the  system.  These 
Include:  use  of  electrodes  which  afford  easier  placement.  Implementation 
of  floating-point  hardware  which  will  provide  us  with  much  more  flexibility 
as  far  as  the  data  analysis  Is  concerned  (e.g.,  differing  window  size  and 


sampling  rate),  simultaneous  sampling  of  signals  from  multiple  muscles,  use 
of  statistical  and  pattern  recognition  algorithms  to  help  find 
correlations,  and  the  capability  to  exert  a  greater  degree  of  control  over 
the  experimental  task  loading. 

It  appears  from  this  preliminary  study  that  actual  task  loading  by  Itself 
Is  not  sufficient  for  the  evaluation  of  feature  dlagnostlclty  due  to  the 
subjective  manipulation  of  mental  effort.  There  are  two  means  of  getting 
around  this  problem.  The  first  Is  to  provide  restrictions  on  experimental 
control  at  the  micro  level.  The  second  Is  to  provide  detailed  data/signal 
analysis  capability  combined  with  more  sensitive  primary  task  measures. 
These  two  methods  are  currently  being  evaluated  with  an  eye  towards  future 
Implementation. 
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APPENDIX  A 


SOFTWARE  SPECIFICATIONS 


Software  Specifications 


Overview 


There  are  three  packages  employed  In  the  MES  acquisition  and  analysis 
process.  Two  are  used  during  the  performance  of  the  experiment  and  one  Is 
used  during  the  off-line  analysis  of  the  MES  data. 

The  two  packages  used  In  the  performance  of  the  experiment  consist  of  one 
package  for  the  COSMOS  system  and  one  for  the  Apple.  The  COSMOS  system  Is 
used  to  control  the  experimental  parameters  and  collect  MES  data  from  a 
subject  through  the  electrodes  and  A/D  board.  The  second  package  Is  used 
on  the  Apple  lie  to  control  the  presentation  of  graphic  Inputs  to  the 
subject,  record  subject  responses,  and  to  print  a  subject  performance 
record. 

The  third  package  Is  comprised  of  the  ARIMA  modelling  routines  and  performs 
analysis  of  the  previously  collected  MES  data  In  batch  mode  under  control 
of  the  experimenter.  The  experimenter  can  enter  up  to  25  files  containing 
MES  data  records  and  the  package  will  compute  either  the  autocorrelations 
and  partial  autocorrelations  of  the  MES  data  (step  one)  or  compute  the 
final  ARIMA  coefficients  (step  two)  for  each  data  record  In  the  selected 
file. 

The  two  packages  running  on  the  COSMOS  system  are  discussed  In  section  A.l. 
Section  A. 2  contains  specifications  of  the  Apple  software. 


A-2 


Data  Acquisition  and  Analysis  Packages 


Both  packages  running  on  the  COSMOS  are  written  In  C.  The  first  package 
which  controls  the  experiment  and  data  acquisition,  consists  of  4  routines 
and  uses  the  Analog-to-DIgltal  converter  driver.  The  high-level  routine 
MES-EXP  controls  the  package.  It  opens  up  a  device  communication  channel 
with  the  Apple  and  calls  two  lower  level  routines  (usr-select  and  set-up) 
to  get  session  parameters  and  set  up  data  files  for  MES  data  collection. 
When  the  operator  Instructs  MES-EXP  to  start  an  experiment,  a  timer  Is 
started  and  the  third  routine  (collect).  Is  called  on  to  collect  data  at 
experimenter  specified  Intervals.  MES-EXP  Instructs  the  Apple  to  stop 
generating  graphics  and  recording  responses,  and  to  generate  a  summary 
report  when  the  session  Is  finished. 

The  routine  usr-select  allows  the  user  to  specify  experiment  type,  level  of 
difficulty,  trial  number  and  the  A/D  channels  used  to  collect  data.  By 
selecting  a  combination  of  1  to  4  channels,  a  sampling  rate  of  2000,  1000, 
500,  or  250  Hz  can  be  selected.  The  experimenter  also  supplies  the  period 
between  sampling  windows  and  the  total  session  length.  The  data  from  each 
window  Is  stored  In  a  separate  record  within  each  data  file. 

The  routine  set-up  allows  the  experimenter  to  specify  particular  files  to 
receive  the  data  from  each  A/D  channel.  A  header  describing  the  contents 
of  the  file  may  also  be  supplied. 

Finally,  the  routine  collect  Is  responsible  for  controlling  the  A/D  and 
collecting  data.  Currently,  500  data  points  are  collected  per  window. 

The  other  package  running  on  the  COSMOS  contains  a  batch  processing  routine 
and  the  ARIMA  routines.  The  batch  processing  routine,  MES-BATCH,  allows 
the  experimenter  to  control  the  analysis  process.  The  experimenter  can 
select  up  to  25  MES  data  files  for  analysis.  He  Is  then  asked  which  stage 


of  the  ARIMA  Identification  process  he  would  like  performed  on  the 
specified  data  files.  If  the  first  stage,  the  Identification  phase.  Is 
specified,  the  operator  Is  asked  the  maximum  level  of  differencing  desired. 
If  the  second  stage  Is  specified,  the  operator  Is  asked  to  Input  the  values 
of  p,  d,  and  q  for  each  record  In  each  of  the  specified  files. 

There  are  three  routines  used  for  the  ARIMA  analysis  —  one  for  each  step 
of  the  process.  The  top-level  routine  for  step  1  Is  USID  which  controls 
the  process  of  computing  autocorrelations  and  partial  autocorrelations  for 
an  NES  data  record.  These  autocorrelations  and  partial  autocorrelations 
are  used  by  the  experimenter  to  estimate  p,  d,  &  q.  The  top-level  routine 
for  step  2  Is  USPE  which  controls  the  calculation  for  the  Initial  estimates 
of  the  autoregressl ve  and  moving  average  parameters.  The  top-level  routine 
for  step  3  Is  USES  which  controls  the  calculation  of  final  autoregressive 
and  moving  average  parameters.  The  function  of  each  routine  in  the  ARIMA 
subsystem  Is  given  In  Table  A-l. 

Calling  Hierarchies 

The  calling  sequences  for  all  routines  are  given  In  Figure  A-l. 

Experimenter  Interface 


(1)  Performing  the  Experiment.  The  experimenter  must  first  boots  up  the 
Apple  lie  experiment  control  system.  The  Apple  lie  then  waits  for  a  run 
command  to  come  over  Its  RS-232  serial  interface.  After  booting  and 
logging  Into  the  68000  system,  the  program  MES-EXP  Is  executed.  The 
following  messages  then  appear  on  the  COSMOS  system. 


TABLE  A-l 


SUBROUTINES  AND  ASSOCIATED  FUNCTIONS 


This  list  contains  the  subroutines  used  by  a  system  with  a  short  statement 
of  function  for  each  routine. 

USIO  -  aids  In  selection  of  p,  d,  &  q 

dlff  -  differences  a  series 

mean  -  gets  the  mean  of  a  series 

acov  *  gets  autocovariances 

stera  -  gets  standard  errors  of  autocorrelations 

pacor  -  gets  partial  autocorrelations 

USPE  -  gets  Initial  estimates  of  and 

atoprm  -  gets  Initial  estimates  of 

modcov  -  modifies  covariances 

movarvr  -  gets  Initial  estimates  of 

whtnos  -  gets  Initial  estimate  for  white  noise  variance 

nwtrph  -  Newton-Rapson  subroutine 

gttmat  -  gets  Immediate  matrix,  tmat,  for  Newton-Rapson  algorithm 

matlnv  -  gets  Inverse  of  a  matrix 

mltmv  -  multiplies  a  matrix  by  a  vector 

USES  -  gets  maximum  likelihood  estimates  of  and 

calcas  -  calculates  conditional  residuals 

ssqr  -  gets  sum  squared  of  a  vector 

calcax  -  calculates  matrix  (see  1.4) 

calcagd  -  calculates  matrix  a  and  vector  g  (see  1.4) 

newest  -  gets  newest  estimates  of  and 

check  -  checks  sum  squared  of  residuals 

covest  -  gets  covariance  matrix  of  estimates 

calcscc  -  gets  standard  errors  and  correlation  matrix 

rsdac  -  gets  residual  autocorrelations 

cal  chi  -  gets  chi-square  statistic  and  degrees  of  freedom 

cnchk  -  convergence  check  for  Marquardt  algorithm 


A-5 


HES-EXP 


FIGURE  A-i. 

CALLING  HIERARCHIES 


MYO-ELECTRIC  SIGNAL  COLLECTION  EXPERIMENT 
TYPE  TASK  TYPE: 

•p*  -  PERCEPTUAL 

V  *  CENTRAL  PROCESSING 

V  -  MOTOR  RESPONSE 

The  experimenter  then  responds  with  the  character  for  the  desired  task. 
The  system  then  prints: 

TYPE  TASK  LEVEL: 

'1 ‘-LOW 
•h'-HIGH 

The  experimenter  responds  with  the  character  for  the  desired  level  of 
difficulty.  The  system  next  types: 

TYPE  TRIAL  NO.,  *1'  or  '2' 

The  experimenter  responds  by  typing  '1*  or  '2'.  The  system  then  types: 

TYPE  EACH  A/0  CHANNEL  USED  SEPARATED  BY  BLANKS 
TYPE  '-1*  FOLLOWED  BY  RETURN  TO  TERMINATE 

The  experimenter  types  the  channels  to  be  used  separated  by  RETURN'S  and 
followed  by  -I.  The  system  then  types: 

TYPE  PERIOD  OF  SAMPLINGS  IN  SECONDS 
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The  user  responds  with  the  desired  value.  Then  the  system  says: 

TYPE  SESSION  LENGTH  IN  SECONDS 

The  experimenter  responds  with  the  desired  value.  The  system  then  prints: 

TYPE  DATA  FILE  NAME  FOR  A/D  CHANNEL  _ 

The  experimenter  responds  with  the  file  name.  The  system  then  responds 
with: 

TYPE  HEADER  FOR  THIS  FILE,  TERMINATE  WITH  '**  RETURN 

The  experimenter  types  In  his  header  and  the  file,  header  sequence  Is 
repeated  for  each  A/D  channel  specified  by  the  experimenter.  After  the 
last  file  and  header  Is  specified,  the  system  responds  with: 

PLACE  AND  POWER  UP  ELECTRODES 
READY  APPLE 

PRESS  RETURN  TO  START  EXPERIMENT 

When  both  the  experimenter  and  subject  are  ready  to  begin  the  session,  the 
operator  presses  the  return  key  to  Initiate  the  experiment.  A  run  command 
Is  then  given  to  the  Apple  and  the  two  systems  begin  operating 
synchronously.  When  the  previously  defined  session  length  Is  reached,  the 
system  prints  out  "EXPERIMENT  TERMINATED”  on  both  screens. 

(2)  Batch  Processing  ARIMA  Analysis.  The  experimenter  runs  the  ARIMA 
analysis  of  the  MES  data  after  the  experiment  has  been  performed  and  the 
data  collected.  He  normally  runs  the  experiment  In  two  stages  for  a  group 
of  MES  data  files.  First  he 


Identifies  p,  d,  4  q  for  any  or  all  of  the  records  In  each  file.  Then  he 
runs  the  system  again  to  find  the  final  autoregressive  and  moving  average 
parameters  for  each  record. 

When  the  experimenter  runs  the  68000  routine  MES -BATCH,  he  sees: 

EMG  ANALYSIS  PROGRAM 
TYPE  CURRENT  DATA  FILE  NAME 

The  experimenter  then  types  the  current  file  name.  The  system  then  says: 

TYPE  *Y*  IF  YOU  WANT  TO  SPECIFY  p.  d.  4  q;  OTHERWISE.  TYPE  V 

The  experimenter  responds.  If  he  types  *y' ,  the  system  says: 

IF  YOU  WANT  TO  PROVIDE  p.  d.  4  q  FOR  RECORD  1.  TYPE  V; 

OTHERWISE  TYPE  V 

The  experimenter  responds.  If  he  types  'y'  the  system  prompts  as  follows 
with  the  experimenter's  responses  underlined: 

P  * _ 

d  ■ _ 

q  ■ _ 

The  system  then  asks  him  If  he  wants  to  specify  p,d»  4  q  for  record  2,  etc. 
up  until  the  user  types  'n'.  The  system  then  says: 

TYPE  'y'  IF  YOU  WANT  TO  SPECIFY  ANOTHER  FILE;  OTHERWISE,  TYPE  V 


If  the  experimenter  responds  with  'y',  the  system  types  out: 

TYPE  CURRENT  DATA  FILE  NAME 

and  the  process  repeats.  When  the  experimenter  finally  says  he  doesn't 
want  to  type  another  file*  the  system  types: 

FILES  TO  BE  USED  ARE: 

(Followed  by  experimenter  specified  files.) 

The  system  then  prints: 

TYPE  ONE  OF  THE  FOLLOWING  COMMANDS: 

T  -  IDENTIFY  P,  D,  A  Q 
V  -  ESTIMATE  PARAMETERS 

The  experimenter  types  the  desired  command  and  the  batch  mode  analysis 
program  begins  writing  the  results  to  either  a  file  or  the  printer. 

A. 2  Experimental  Control  Package 

The  Experimental  Control  package*  Implemented  in  GRAFORTH  on  the  Apple  lie 
Is  capable  of  supporting  three  separate  experiments: 

(1)  Perceptual  experiment. 

(2)  Control  experiment. 

(3)  Motor  response  experiment. 

(1)  Perceptual  Experiment.  This  experiment  tests  the  subject's  ability  to 
monitor  and  respond  to  a  series  of  ongoing  events*  on  up  to  four  separate 
displays.  This  emulates  the  events  displayed  to  the  pilot  on  aircraft 
gauges. 


Each  display  consists  of  a  horizontally  graduated  scale  with  an  Initially 
centered  arrow.  The  arrow  oscillates  back  and  forth  around  the  mean  using 
a  preset  event  scheduler  which  eventually  drives  the  mean  off  center.  The 
subject  Is  expected  to  keep  the  arrow  mean  centered  using  dedicated  keys. 
The  performance  of  the  subject  Is  measured  according  to  his  response  time 
to  each  Individual  event. 

The  arrival  time  of  the  event  Is  In  accord  with  a  Poisson  distribution  on  a 
Pre-Set  Schedule.  There  are  two  levels  of  difficulty  Implemented  on  this 
experiment. 

The  subject  Is  presented  one  or  four  sets  of  horizontal  scales  and 
oscillating  arrows.  He  responds  to  a  change  In  the  mean  of  oscillation  for 
any  or  all  of  the  arrows  by  pressing  the  correct  arrow  key  on  a  dedicated 
keypad  (Figure  A-2). 


FIGURE  A-2. 
RESPONSE  KEYPAD 


Each  pair  of  keys  corresponds  to  the  scale  and  arrow  located  In  the  same 
quadrant  on  the  screen.  The  correct  response  to  a  mean  shift  Is  to  press 
the  arrow  key  In  the  direction  In  which  the  mean  has  shifted. 

Performance  Evaluation.  When  an  event  occurs  (l.e.,  mean  about  which  the 
arrow  oscillates  In  accord  with  a  preset  schedule)  It  Is  stored  In  an  event 
buffer  along  with  Its  occurrence  time.  The  subjects  response  to  the  event 
(l.e.,  key  presses)  Is  also  stored  with  Its  time  tag.  A  summary  printout 
of  events  Is  given  upon  termination  of  the  experiment. 

(2)  Control  Processing.  In  this  series  of  experiments  the  objective  Is  to 
measure  the  subjects  ability  to  match  letters  or  words  In  a  given  limited 
decision  time.  The  experiment  is  administered  at  2  levels  of  difficulty 
(l.e..  Induced  cognitive  load). 

(1)  Matching  letters  (easy). 

(2)  Matching  antonyms  (difficult). 

From  a  predefined  table  of  words  and  letters  stored  In  memory  the  subject 
Is  presented  with  pairwise  letters  or  words  and  given  two  seconds  to 
respond.  He  Is  expected  to  respond  by  pushing  either  one  of  two  buttons 
labled  TRUE  or  FALSE. 

The  system  records  the  correct  response  to  the  event  (TRUE,  FALSE)  as  well 
as  the  subject's  actual  response. 

Performance  Evaluation.  Each  event  associated  with  the  display  of  a  letter 
pair  or  word  pair  Is  stored  In  terms  of  Its  value  and  associated  occurrence 
time  In  the  buffer.  The  event  associated  with  the  subject's  response  Is 
also  stored  along  with  Its  time  of  occurrence. 


The  summary  printout  consists  of  messages  such  as  EVENT*TRUE  or  FALSE  along 
with  the  corresponding  time  of  occurrence  with,  followed  by:  RESPONSE-TRUE 
or  FALSE  corresponding  to  the  subject's  response  along  with  the  time  of 
that  response.  Lack  of  correspondence  between  stimulus  events  and 
subject's  responses  are  flagged  by  error  messages  of  the  type:  ERROR  IN 
RESPONSE  X. 

(3)  Motor  Response  Experiment.  The  experiment  measures  the  subject's 
motor  response  ability  using  a  deflected  object  on  the  screen  which  Is 
controllable  via  a  joystick  Interface  to  the  Apple. 

A  graphic  representation  of  a  horizontal  bar  with  a  moving  block  Initially 
at  Its  center  Is  displayed  on  the  screen.  The  block  Is  continuously 
deflected  In  accord  with: 


^^new  *Wt)  +  x(y(t)+k  x(t» 

where 

ynew(t)  ■  new  position  of  block  on  scale 
y(t)  *  new  old  position  of  block  on  scale 

x(t)  »  joystick  deflection  from  center 

x  »  level  of  difficulty 

k  *  constant 


The  net  effect  Is  that  the  block  Is  always  being  forced  off-center  to 
either  end  of  the  bar.  The  software  continuously  reads  the  joystick  Inputs 
to  the  system  and  Incorporates  the  latest  values  In  computing  the  new 
position  of  the  block,  this  experiment  tests  the  subject's  ability  to  keep 
the  block  centered  with  the  help  of  a  joystick  control. 

The  2  levels  of  difficulty  which  are  used  In  the  experiment  are 
Incorporated  in  calculating  the  new  position  of  the  block.  The  higher  the 
level  of  difficulty,  the  harder  it  Is  to  control  the  block.  Throughout  the 
experiment,  the  following  Information  Is  collected: 

o  Value  of  off-center  distance 

o  Edge  collisions 

For  a  successful  control  trial  (l.e.,  no  edge  collisions),  the  last  100 
sample  values  of  the  distance  of  the  block  from  the  bar's  center  Is  stored 
In  the  memory  buffer.  Then  the  RMS  distance  values  are  calculated.  For  a 
trial  In  which  edge  colllslon(s)  have  occurred,  the  elapsed  time  and  the 
accumulated  RMS  distance  value  for  the  particular  control  attempt  was 
recorded.  At  the  end  of  the  trial,  the  time  duration  and  the  average  RMS 
values  across  the  control  attempts  were  calculated  and  printed  out  In  a 
summary  report.  A  listing  of  the  FORTH  "words"  used  Is  given  In  Table  A-2. 


TABLE  A- 2 


FORTH  "Words’*  AND  ASSOCIATED  FUNCTIONS 


Initialize  clock 
Initialize  conns 
clear  buffer 

conn 

decode  start 
decode  run 

start  exp  0 

start  exp  1 

start  exp  2 

maintain  exp  0 
maintain  exp  1 
maintain  exp  2 
zero  event  tab 
zero  mean  tab 
set  seed 
board 
narrow 
get  -  key 
arrowmean 

good/bad 

net  dot 


-  Initializes  the  real  time  clock  on  Apple  2e 

-  Initializes  the  serial  communications  card  on  2e 

-  Clears  the  Internal  buffer 

-  Initiates  communications  between  2e  and  68000 

-  Receives  Initial  starting  messages  from  68000 

-  Decodes  Interrupts  from  68000  key  board  during 
experiment 

-  Sets  Initial  conditions  variables  to  start  the 
perceptual  experiment 

-  Sets  Initial  conditions  variables  to  start  the 
central  experiment 

-  Sets  Initial  conditions  variables  to  start  the 
motor  response  experiment 

-  Monitors  events  In  perceptual  experiment 

-  Monitors  events  In  central  experiment 

-  Monitors  events  In  motor  response  experiment 

-  Event  table  for  perceptual  experiment 

-  Table  of  means  for  perceptual  experiment 

-  Sets  up  a  random  number  generator 

-  Draws  graphic  scale  for  motor  response  experiment 

-  Draws  graphic  displays  for  perceptual  experiment 

-  Reads  subject  response  to  various  experiments 

-  Subroutine  to  oscillate  arrow  In  perceptual 
experiment 

-  Determines  if  events  In  central  experiment  are  true 
or  false 

-  Calculates  continuous  new  positions  for  block  In 
motor  experiment 


TABLE  A- 2  (Cont'd) 


edge  test 

get  RMS 
store  events 

ptlme 
prlnten 
stick  pos 
draw  dot 


-  Checks  for  edge  collision  in  motor  response 
experiment 

-  Calculates  the  RMS  values  In  motor  response 

-  Stores  all  events  (key  strokes,  etc)  In  Internal 
buffer 

-  Reads  clock  and  stores  event  time 

-  Prints  contents  of  buffer  In  a  readable  format 

-  Reads  joystick  values 

-  draws  graphic  for  motor  response  experiment 


APPENDIX  B 


SUBJECTS  INSTRUCTIONS 


This  experiment  is  part  of  a  program  of  continuing  research  at 
Perceptronics  in  human  (pilot)  performance  and  decision  making.  The 
purpose  of  this  particular  experiment  is  to  analyze  ways  in  which  human 
operators'  myoelectric  (muscle)  signals  respond  and  how  a  computer  might 
help  to  determine  an  operator  s  mental  state  via  these  signals.  You  are  an 
integral  part  of  this  research  since  your  performance  provides  the  baseline 
data  for  predicting  operator  performance,  and  estimating  the  effectiveness 
of  computer-based  analysis  techniques. 


There  are  three  types  of  tasks  that  you  will  be  asked  to  perform  in  the 
experiment  They  are:  (1)  perceptual  (or  probability  monitoring)  task,  (2) 
central  processing  (or  linguistic  processing)  task,  and  (3)  motor  (or  control) 
tracking  task.  Within  each  task,  there  are  two  difficulty  levels  -  low  and 
high.  Tou  will  be  given  direction  as  to  the  specific  type  and  difficulty  level 
of  the  task  and  the  approximate  time  it  will  take  to  complete.  Please 
concentrate  on  the  task  as  your  response  and  performance  will  be  closely 
monitored  and  scored  based  on  both  your  response  time  and  response 
accuracy.  (We  will  have  a  bonus  for  the  best  performer  after  we  have 
completed  the  experiment)  At  the  end  of  each  run,  you  will  be  given  a 
questionnaire  to  fill  out  Information  on  these  questionnaires  will  not  be 
used  to  rate  your  score,  so  please  use  your  unbiased  judgment  to  answer 
those  questions. 

The  following  paragraphs  describe  the  three  types  of  tasks. 

Perceptual  (Probability  Monitoring)  Task.  In  this  task,  you  will  be 
asked  to  monitor  a  hypothetical  instrument  panel  of  one  or  four  gauges, 
each  with  a  moving  arrow.  The  arrow  has  a  set  range  of  fluctuation  around 
the  center  of  the  dial.  Occasionally,  a  particular  arrow  will  start  to  drift  to 
the  right  or  left,  fluctuating  not  about  the  center  but  around  one  of  the 
divisions  to  the  right  or  left  of  center.  This  signifies  an  abnormal  event 
occuring  in  the  underlying  instrument,  and  you  can  correct  the  event  and 
the  drifting  by  hitting  one  of  the  right  or  left  buttons  for  the  corresponding 


dial.  If  the  arrow  has  drifted  to  the  right,  press  the  right  arrow  button  and 
visa  versa.  If  you  do  it  correctly,  the  arrow  will  move  back  to  the  center 
again.  Please  respond  to  any  detected  event  as  soon  as  possible  and  try  not 
to  make  mistakes  in  button  selection,  not  to  make  a  false  alarm  (guess 
about  the  event)  or  miss  an  event  The  performance  will  be  evaluated  by 
the  combined  score  of  average  response  time  and  percentage  of  incorrect 
actions  (including  mistakes,  false  alarms  and  missed  events). 

Central  Processing  (Linguistic  Processing)  Task.  In  this  task,  you 
will  see  a  sequence  of  letter  pairs  or  word  pairs  shown  on  the  screen  every 
two  to  three  seconds.  Tou  will  be  asked  to  compare  and  classify  them  as 
"same”  (true  event)  or  “different*  (false  event)  based  on  (1)  the  character 
catagories  (eg.,  aa,  cc  are  the  same  pairs;  ae,  ac  are  different  pairs.  Upper 
and  lower  case  representations  of  the  same  letter  [eg.,  Aa)  are  classified  as 
different);  or  (2)  the  antonym  catagories  (true  event  if  the  two  words  are 
antonyms  [i.e.,  opposites]  and  false  event  if  otherwise).  Please  respond  as 
soon  as  you  can  and,  at  the  same  time,  avoid  making  any  mistakes.  A 
decision  needs  to  be  made  before  the  next  pair  appears  so  that  you  don't 
miss  any  response  opportunities.  Missed  events  and  incorrect  responses 
will  be  registered  as  errors. 

Motor  (Control)  Tracking  Task.  In  this  task,  you  will  see  a  cursor  which 
moves  on  a  horizontal  axis.  Tou  will  be  asked  to  use  a  joystick  to  maintain 
the  cursor  as  dose  to  the  center  as  possible.  A  tone  will  be  given  when  the 
cursor  moves  off  the  scale  and  the  cursor  will  start  from  the  center  again. 
Performance  will  be  measured  as  ( 1)  the  average  time  until  loss  of  control 
and  (2)  the  closeness  of  the  cursor  to  the  center  of  the  axis  averaged  over 
the  entire  trial. 
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-8.236666a-02 

-1.9069228-01 

3.2023438-02 


3.9870318-01 
-1.7723998-01 
-1.2449738-01 
7. 4489278-02 


3. 9718448-01 
-2. 4968938-01 
-7. 3362328-02 
3.3862068-02 


STANDARD  ERRORS  OF  AUTOCORRELATIONS: 


0. 0000008+00 
9. 8392698-02 
1.0164968-01 
1.0392238-01 
1.0423348-01 


7. 0965938-02 
9.8444048-02 
1.0280918-01 
1.0393618-01 


8. 3908738-02 
9. 8381778-02 
1.0331418-01 
1.039882S-O1 


9. 388340a-02 
9. 9217048-02 
1.0381318-01 
1.0409488-01 


9. 7183988-02 
1.0046598-01 
1.0392238-01 
1.0415468-01 


PARTIAL  AUTOCORRELATIONS: 


8. 7123018-01 
-1.8112738-01 
-4. 6181278-02 
-8. 0222208-02 


2. 692793a-02 
1. 1999308-02 
4. 9148058-02 
-2.6014868-02 


-3. 0629498-01 
8.3471338-02 
1.3816218-02 
7. O78087a-02 


-3. 1100788-01 
-1.6120888-03 
-6. 271049e-02 
-2. 9243508-02 


8.8403108-02 
9. 7433298-02 
2. 3643678-02 
9. 288832a-02 


STANDARD  ERROR  OF  PARTIAL  AUTOCORRELATIONS  -  4.47213&8-02 
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EMG  ANALYSIS  PROGRAM 

FILE  IS  ps2. data 
Robart  4/16/84  14i30 

NO.  OF  RECORDS  ■  3  NO.  OF  SAMPLES 

RECORD  -  1 

DATA  i 
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-36 

-50 

-49 

-27 
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-37 
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-27 

-41 

-12 

-a 

-23 

-28 

-23 

-38 

-57 

-56 

-52 
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S3 

56 

41 

2 

-17 

-44 
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-33 
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-41 

-46 
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-49 
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-49 

-34 
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-49 
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-44 

-31 

-39 

-36 

-46 

-23 

-20 

-27 

-34 

-42 

-33 

-64 
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-14 

6 

37 

21 

37 

-43 
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-30 
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-33 
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-47 

-33 

-48 

-59 

-31 

-60 

-49 

-43 

-61 

-36 

-42 

-43 

-42 

-51 

-40 

-37 

-31 

-48 

-41 

-36 

-50 

-33 

-38 

-34 

-24 

-38 

-19 

-26 

-25 

-39 

-65 

-57 

-52 

-29 

36 

56 

41 

-3 

-32 

-40 

-49 

-42 

—45 

-30 

-48 

-49 

-47 

-52 

-50 

-25 

-58 

-43 

-49 

-52 

-50 

-46 

-43 

-45 

-38 

-39 

-46 

-39 

-37 

-35 

-25 
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-21 
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-46 
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-45 

-29 
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-28 
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-69 

-37 

-39 

51 

56 

26 

16 

-30 

-45 

-30 

-49 

-52 

-56 
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-41 
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-49 
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-39 
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-43 

-40 

-36 

-42 
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-37 
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-26 
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-51 

-48 

-14 

27 

26 

36 

51 
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-44 
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-46 
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-44 

-41 
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-47 

-50 

-42 

-41 
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-46 

-35 
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-39 

-40 

-52 

-54 

-37 

-45 

-37 

-49 
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-66 
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-49 
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-36 

48 

35 

38 

-5 

-33 

-35 

-58 

-33 

-49 

-39 

-38 

-52 

-46 
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-47 

-36 

-36 

-41 

-47 

-53 

-44 

-50 

-51 

-41 

-32 

-31 

-45 

-43 

-41 

-28 

-27 

—43 

-33 

-42 

-35 
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-51 

-53 

-14 

9 

37 

31 

49 

-36 

-48 

-42 

-56 

-49 

-47 

-44 

-37 

-51 

-37 

-40 

-46 

-38 

-47 

-52 

-36 

-44 

-50 

-33 

-32 

-32 

-46 

-38 

-48 

-46 
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-45 
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-44 
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-34 
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-31 
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-38 

-35 

55 

59 

22 
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-43 
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-37 
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-45 

-36 

-43 

-46 

-32 

-52 

-43 

-39 
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-53 
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-42 

-32 

-45 
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-49 

-47 

-52 
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-51 

-57 
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-34 
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13 
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Apr  29  13t04  1984  Estimation  Psgs  2 


-39 

-48 

-SI 

-41 

-39 

-44 

-34 

-47 

-30 

-41 

-40 

-33 
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-37 
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-81 

UNIVARIATE  STOCHASTIC  MODEL  PRELIMINARY  ESTIMATION 
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-SO 

-51 

-47 

-32 

-42 
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-27 

-34 

-29 

-20 
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-37 

-38 

-39 

-53 

-40 

-63 

-72 

-71 

-69 

-37 

-39 

0 

13 

29 

48 

37 

51 

56 

26 

16 

-30 

-49 

-33 

-43 

-50 

-38 
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-30 
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-36 
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-34 

-43 
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-48 

-56 

-44 

-48 

-41 

-48 

-35 

-50 

-44 

-49 

-43 

-49 

-44 

-39 

-49 

-45 

-39 

-55 

-34 

-31 

-43 

-40 

-36 

-48 

-44 

-51 

-35 

-43 

-43 

-48 

-39 

-48 

-51 

-41 

-39 

-44 

-34 

-47 

-30 

-41 

— 4G 

-33 

-35 

-18 

-31 

-36 

-86 

-38 

-83 

-89 

-83 

-48 

-58 

-40 

-54 

-68 

-58 

-60 

-86 

-18 

17 

18 

37 

49 

56 

64 

51 

33 

7 

-37 

-53 

-48 

-46 

-45 

-47 

-49 

-39 

-58 

-50 

-47 

-40 

-49 

-31 

-49 

-51 

-41 

-39 

-55 

-39 
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-57 
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-73 

-60 

-64 

-76 

-61 

-73 
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-81 

NUMBER  OF  DXFFERENCIN8S  -  8 

NUMBER  OF  AUTOREGRESSIVE  PARAMETERS  -  6 

NUMBER  OF  MOVING  AVERAGE  PARAMETERS  -  0 

DIFFERENCED  AND  TRANSFORMED  SERIES* 
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-6 

7 
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20 
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61 
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-38 

-37 

-35 

-3 

-3 

34 

47 

63 

82 

71 

83 

90 

60 

50 

4 

-15 

-1 
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-16 

—4 
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4 
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-a 

-1 
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-13 
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-8 

-10 
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-9 

-a 

-3 

-14 
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-3 
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-13 

4 

-7 

-6 
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-1 

16 
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-2 

a 

-4 

11 
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11 

-8 

-16 

-6 

-20 

-28 

-24 

-26 
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16 

31 

46 

71 

83 

90 

98 
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67 

41 

-3 

-19 

-8 

-12 

-11 

-13 

-13 

-3 

-24 

-16 

-13 

-6 

-13 

3 

-15 

-17 

-7 

-3 

-21 

-5 

-17 

-23 

-16 

-39 

-26 

-30 

-42 

-27 

-39 

-26 

-47 

AUTOCOVARIANCES I 

6. 618940*+02  5. 766&20S+02  3.067000*4-02  3.962780*+02  2.628940*+02 

1.607760S+02  3.327000*4-01 

INITIAL  ESTIMATES  OF  AUTQRE8RESS I VE  PARAMETERS* 

6. 042637s-01  3. 107581s— 01  -8. 633633*-02  -3. 09S668*-01  2.311791m-01 

-1. 811271*-01 

INITIAL  ESTIMATES  OF  MOVING  AVERAGE  PARAMETERS* 


INITIAL  ESTIMATE  OF  WHITE  NOISE  VARIANCE  -  1.231863*4-02 

UNIVARIATE  ST0CHA8TIC  MODEL  ESTIMATION 

hC13  *  1.120436*^-02  phi2C13  -  8. 134680m-01 
h C23  ■  -4. 626880m— 03  phi2C23  •  3.061312m-01 
hC33  -  -8. 433 1 33a— 04  phi2C33  -  -8. 739984*-02 
h C43  ■  -7. 891212s— 03  phi2C43  -  -3. 174380*-01 
hC33  -  1. 182190m— 02  phi2C33  -  2. 4300 10s- 01 

h  C63  ■  —4. 118866m— 03  phi2C63  -  -1. B52460*-01 

S(B0)  «  3.994822*^04  S(B)  -  3.  990726*+04 

h  C13  -  6.  477033*— 03  phi2C13  -  8.219450*-01 

hC23  »  -3. 424129*-03  phi2C23  ■  3.007071*-01 

h  C33  -  -1. 283012*— 03  phi2C33  -  -8.  868285*-02 
hC43  -  -3. 04836S*-03  phi2C43  -  -3. 225065*-01 
hC33  ■  1. 012739*— 02  phi2C33  ■  2.531284*-01 

hC63  -  -3. 846748*— 03  phi2C63  -  -1. 890927*-01 

S  (B0>  a  3.990726*4-04  S(B)  -  3. 989479*+04 

hC13  >  3. 048000*— 03  phi2C13  a  8.249929*-01 

h  C23  «  -3. 067821*— 03  phi2C23  -  2.  976393*-01 

hC33  a  -6. 991340*— 04  phi2C33  -  -8. 938198*-02 
hC43  -  -1. 77l282*-03  phi2C43  ■  -3. 242778*-01 
hC33  >  3. 238203*-03  phi2C33  ■  2.383866*-01 

h C63  a  -2. 474323*-03  phi2C63  ■  -1.  913670*-01 
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16 
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-8 

-16 

-6 

-20 

-28 

-24 

— .  S 
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51 

46 

71 
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90 
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f  7 

41 

-3 
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-13 
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-15 
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AUTOCOVARIANCES* 

-39 

-26 

-30 

-42 

-27 

-  3 

16 

-47 

6.6189409+02 

1.6077609+02 

5. 7666209+02 
3. 3270009+01 

3. 0670009+02 

3. 

9627809+02 

2. 

6289409+02 

INITIAL  ESTIMATES  OF  AUTOREGRESSIVE  PARAMETERS* 

8. 0426379-01  3. 107381 *-01  -8. 6336339-02  -3. 0956689-01  2.3117919-01 

-1.  81 12719-01 


INITIAL  ESTIMATES  OF  MOVING  AVERAGE  PARAMETERS* 


INITIAL  ESTIMATE  OF  WHITE  NOISE  VARIANCE  «  1.2518639+02 


UNIVARIATE  STOCHASTIC  MODEL  ESTIMATION 


hC13 
h  C2J 
h  E3] 
h  C4D 
h  C53 
h  C63 


1.  1204369-02  phi2ClD 
-4. 6268800-03  phi2C23 
-8. 433133e-04  phi2C33 
-7. 891212e-03  phi2C4D 
1. 182190a-02  phi2C33 
-4.1188669-03  phi2C63 


-  8. 1546809-01 

-  3. 0613129-01 

-  -8.7399849-02 

-  -3. 1745809-01 

*  2. 4300109-01 

■  -1.8524609-01 


S(B0)  ■  5.9948229+04  S(B)  -  5.9907269+04 


h  C13  *  6.4770339-03  phi2C13 

h  C23  =  -5.424l£3e-03  phi2C23 
h  C33  ■  -1.2830129-03  ohi2C33 
h  C43  »  -5.0483659-03  phi2E43 
h  C53  =  1.0127399-02  phi2C33 

hC63  »  -3.8467489-03  phi2E63 


8. 2194509-01 
3. 0070719-01 
-8. 8682859-02 
-3.2250659-01 
2.5312849-01 
-1.8909279-01 


S(B0>  -  5.9907269+04  S(B>  »  5.9894799+04 


h  C13  ■  3.0480009-03  ph i 2  C 1 3 

h  C23  »  -3.0678219-03  phi2C23 
h  C33  -  -6.9913409-04  phi2C33 
h  C43  *  -1.7712829-03  phi2C43 
h  C33  ■  5.2382039-03  phi2C33 

hC63  -  -2.4743239-03  phi2C63 


8. 2499299-01 
2. 9763939-01 
-8.9381989-02 
-3. 2427789-01 
2.5838669-01 
-1. 9136709-01 
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SCB0) 


5.989479a+04  S(B)  -  3. 989257a+04 


hC13  »  8. 952189a-04  phi2C13 
h  C21  -  -9. 962639a-04  phi2C2I 
hC33  -  -2. 281227a— 04  phi2C33 
h  C4I  -  -3.  3076428-04  phi2C4I 
h  C53  ■  1 . 568982b-03  phi2C53 
h  CGI  »  -8. 3724618-04  phi2C6I 


8. 23888 la-01 
2. 9684308-01 
-8.9610108-02 
-3.2460868-01 
2. 3993368-01 
— 1. 924243a— 01 


S(B0>  -  5.9892378+04  S(B> 


3. 9892448+04 


hCl!  ■  1.1784918-04  phi2tl 3  - 

h  C23  »  -1.6585238-04  phi2C23  ■ 
h  C33  »  1.4576SS--06  phi2C33  -  ■ 

h  C43  »  -3.2727398-05  phi2C43  - 
h  C33  -  2.0158618-04  phi2C33  * 
hCS3  -  -1.1882488-04  phi2C63  - 

3<B0)  *  S>.9£ijL  5, 

FINAL  AUTOREGRESSIVE  PARAMETERS 

8. 23888 la-01  2. 9664308-0 1 

-1.9242438-01 

FINAL  MOVING  AVERAGE  PARAMETERS 


8. 2600598-01 
2. 9647718-01 
8. 9608648-02 
■3.  2464138-01 
2. 6015718-01 
-1.9254318-01 

9892418+04 


8.9610108-02  -3.2460868-01 


FINAL  RESIDUALS: 


0. 0000008+00 
0. 0000008+00 
1.0526428+01 
-3. 1639098+00 
1. 238338a+01 
-4. 144789e-02 
-6. 3208018+00 
1.3317708+01 
1.6973248+01 
-9. 043783e+00 
-7. 3361138+00 
-2. 381016e+00 
-7. 7994418+00 
7. 599121e-01 
7.6994418-01 
-8.23U65e+00 
-1. 1434288+01 
9. 6034798+00 
4. 872372a+00 
-2. 7880968+00 
-5. 7015748+00 
-1.036178a+01 
-1.0970228+01 
6. 184477a+00 
1.749267e+01 
2. 0809288+01 


0. 0000008+00 
-1.2770108+01 
-7. 7939238+00 
1.5068598+01 
3. 0949988+00 
-2. 8096698+00 
-2. 9636698+00 
3. 5605448+01 
6. 673498S+00 
1.7436028+01 
-1.8688408+01 
1.7766838+00 
8. 381496S-01 
4.2350048-01 
-2. 2068508+00 
-3. 3884778+00 
9. 6176768+00 
4.6243888-01 
-1. 1633618+01 
-8. 1960518+00 
-1. 186718e+01 
7. 6374648+00 
-7.2160788+00 
6. 326872e+00 
1.9234508+01 
2. 1641558+01 


0. 0000008+00 
-4. 6931098+00 
-8. 9570238+00 
5. 8002028+00 
-1.2333868+01 
-6. 8839958+00 
-1. 1125958-03 
-4. 1367338-01 
1.342141e+00 
1.3442688+01 
2.048324e+01 
-2. 0900108+00 
-1. 5502638-02 
-7.6817438+00 
3.3143478+00 
-4. 3290638+00 
-1.9062558+01 
-1.3974268+00 
8. 0593008+00 
-1.2027498+00 
1.3746068+01 
1.3228888+01 
7.6414998+00 
4. 5952558+00 
2.4136048+01 
-1.2372838+01 


0. 0000008+00 
-7. 3236368+00 
1.3212538+01 
-1. 7644038+00 
-7. 0933968+00 
-6. 7071438+00 
3. 1770148+00 
6. 2126038+00 
-2. 3903098+01 
1.2562538+01 
-2.0066618+01 
8. 1517938-01 
—9. 2559198+00 
-3.4099218+00 
-9. 2329918+00 
-2. 4992238+00 
-6. 3785008+00 
-1.6528468+01 
-5. 6367128+00 
-8.6561328+00 
1.3240838+01 
-6. 264978e+00 
-2.2324318+01 
-2. 9501218+00 
-1.2367958+01 
-2.7105338+01 


2.3995368-01 


0. 0000008+00 
7.8171048+00 
•1.2787718+01 
1.7380078-01 
1. 1894638+01 
2. 6001488+00 
1. 6908658+01 
1. 6584228+01 
•7.  3008598+00 
9. 6409418+00 
6. 6396778+00 
■5.  9533738+00 
2. 0855778+00 
•7.  1019938+00 
1.0620188+01 
4. 8766548+00 
1.0021038-02 
8. 0932848+00 
6. 6326188+00 
1. 4347278+01 
•1. 3736188+01 
5.  9401848+00 
■1.3789248+01 
7. 5635678+00 
1. 1647358+01 
1.7S8933e+01 


Apr  29  13:04  1984  Estimation  Page  6 


7. £S9324e+00 
9. £42917e-01 
-l.£66953e+01 
1. I91416e+01 
1. 375953e+01 
-2. 635986e+00 
“1. 840662a+00 
-9. 96397 le-01 
S. 8309308+00 
5. 177436e-01 
1. 008683a+01 
-1. 212946e+01 
1. 623851e+01 
-2. 0167S5*+01 
-1.226391e+00 
1. 192906a+01 
1.825299e+01 
1.625632e+01 
8. 557823a+00 
-1. 99531 le+01 
-5. 8452009+00 
9. 5818269+00 
2. 194934e+01 
2. 736074a+00 
-2. 557199e+01 
8. 408967e+00 
3. 5203069+00 
3. 3631509+00 
1. 636056e+01 
-3. 229466e+00 
-2. 593909e+00 
-9. 420988e+00 
2. 1355729+01 
1.0633378+01 
1.542694e+01 
8. 932803e+00 
-9. 9827809+00 
7. 058423e+00 
2. 942968e-01 
-1. 927508e+00 
-1.2478719-01 
5. 08272 le+00 
-6. 243958C+00 
2,  404419e+e*v 
7.3867309+00 
-2. 752629e+00 
1. 746983e+00 
1. 1970908+00 
-1.531169e+01 
2.8170509+01 
1.3138659+01 
-6.9784199+00 
4.0855098-01 
1.455321e+01 
-4. 3077988+00 
-7. 9201509+00 


1.4401389+01 
-2. 1984889+01 
3.0726148+00 
-1.0194618+01 
-2.2930848+01 
7. 4064028+00 
-4. 2222538+00 
-5.8133038+00 
4.7360318+00 
9. 2023218+00 
-1.3357208+01 
1.3S2182a+01 
-1.3996468+01 
1.1487398+01 
-9. 1424338+00 
1.9168358+01 
1.2590968+01 
7. 9250088+00 
-6. 9087878+30 
-1.287818a+00 
-4. 9467948+00 
-6. 9238828+00 
-2.6391868+01 
4. 7255838-02 
-2. 2684968+00 
-1.6331718+01 
-3. 3593048+00 
-1.6219108+01 
-7. 0818878+00 
-9. 9692468+00 
-9.6123138+00 
2. 4641658+00 
1. 1377948+01 
1.8402678+01 
7. 2774948+00 
-6.7831228+00 
7. 1857658+00 
-7. 8301628+00 
-3.8146538+00 
6. 1785669+00 
7. 1570218+00 
7.5616329+00 
1 . 9493528+00 
-8.9351148+00 
6. 1393 128+00 
l.S88173e+00 
1.6546258+01 
1 . 5984058+00 
-3. 8379668+00 
1. 1079129+01 
2. 0860748+01 
2.7118838+01 
6. 640474e+00 
-5. 0276858+00 
-1.3010028+01 
7. 9002668+00 


2. 3911838+01 
1.3770928+01 
3. 6942278+00 
-4.6871948+00 
7. 6031008-01 
6. 148254e+00 
-7.0577018+00 
6. 7481079+00 
-5. 1609248-01 
-3. 1042038+00 
1.003529a+01 
-5. 1600608-01 
1. 1840118+01 
-3. 0666398+00 
3. 9030208+00 
2.4172878+01 
-7.6731998+00 
1. 1570108+01 
-2. 93165&8+00 
5. 0962648+00 
-3. 390229a+00 
9.0685728-01 
-9. 5063508-01 
-1.5388618+01 
8. 3938198+00 
1.4187458+00 
-4. 9523868-01 
9.3551888-01 
-1. 8573269+00 
-2. 8057568-01 
-3. 4049128+00 
-2. 1159938+00 
1.9496998+01 
-2.0270788+01 
2. 4278039+01 
9.2560108+00 
-7. 8237158+00 
-4. 664589e+00 
5. 3594608+00 
-1. 3638098+01 
-7. 7828248+00 
-1.0146908+01 
1. 3525168+00 
5. 787901e+00 
-2.2137248+00 
2.439854e+01 
-2. 1547348+00 
-1.4930608+01 
6. 7808938+00 
1.4654278+01 
-1.3897618+01 
1.2385238+01 
-1.7923578+01 
4. 2024958+00 
8. 7400808+00 
-1.7658888+01 


-3. 7924398+60 
-4. 3822948+80 
-9. 7333348+80 
3. 3298548+80 
4. 3236418+80 
-6.9679918+0 
1.1414958+  3 
-8.8252018+  0 
-1. 9408698+  1 
-1.2733838+61 
2. 5648628-  1 
-1.3956098+1 
1. 7033308+  3 
-9. 3625998+0 
3. 240665''+  0 
-2.7250138+  3 
-2.7867038+  1 
-3. 8767868+0 
-1. 1704118+0 
-1.0102208+1 
-1.2002038+:  0 
-9. 6904438+  3 
-1.2225388+  3 
1.2941138+  1 
-4. 1303798+  3 
-7.1282328+  3 
3. 2154838+60 
-1.  0312978+C  1 
1. 1267088+G1 
9. 3799678+S0 
-4. 9069708+60 
1.7231268+1 
2. 1390118+1 
-1.7161058+1 
-3. 7924398+C  0 
1. 07499 18+f  0 
3. 2030458+3 
8. 912042B+C  3 
1.9715658-n 
-9. 8629338+  3 
1.7897968+  3 
2. 1765328+  3 
-9.1177278+  0 
-1.046367e+  1 
1.0246038+1 
-1.2990338+1 
-7. 8 158608+3 
1  •  2628808+=  1 
2. 150186a+Cl 
1. 1495558+G1 
-4. 7637108+03 
-8. 1166258+03 
-7. 0397728+00 
1.0582498+00 
1. 5353308+00 
6.7711358-01 


1.0308818+01 
2. 0473808+00 
-1.2030248+01 
-1.2279248+01 
-1.2333728+01 
-4. 8327988+00 
-7. 061078e+00 
-3. 8620138+00 
2. 7964798+00 
-3. 7724508+00 
1. 1468648+00 
3. 8321948+00 
-1. 1608788+00 
-6. 9633718+00 
1 . 7463388+01 
1.3837618+01 
-1.3988038+01 
8. 6993138+00 
1. 1832118+01 
3. 6575248+00 
-5. 6376728+00 
-8. 4042028+00 
5.9991418-01 
6. 1679168+00 
1. 1580108+00 
-7. 3394348-01 
6. 8804188-01 
6. 1959008+00 
-3. 2838008-01 
1.5756538+00 
-4.  141139e+00 
9.  )05229a-01 
8. 3710738-01 
-2. 0196348+01 
-7. 372306e+00 
-1.  '115763«+01 
-7. 3430000+00 
-1.493804c +01 
-1. 0465809+01 
5. 4363598+00 
-1.5926918+01 
-1. 1206028+01 
-1.7484458+00 
-1. 1079198+01 
-2. 1482968+01 
-7. 4020298+00 
-7. 8837758+00 
-1.7627248+01 
-1.4063668+00 
5. 5954068-01 
-2.2114408+01 
1.6099938+01 
-7. 9353888+00 
-1. 1817808+01 
8. 6475468-01 
-4. 4010158+00 
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S. 329054e^0O 
-3. 440457e+00 
-1.5009376+01 
-5. 577973e+00 
5. 640793a+00 
-1.010157B+01 
-9. 3285208-01 
-8. 776189a+00 
6. 943098e+00 
-1.5630408+01 
2. 8722448+01 
1.0164078+01 
-3.2465518+30 
-3. 1068848-31 
7. 1C 5964e+00 
5.9  76608+00 
-1.2  33068+01 
-1.  5  +91408+01 


-1.0486648+01 
7. 0077908+00 
-7. 0906048+00 
1.4468348+01 
-1. 4236648+01 
6. 2737358+00 
2.2461158+00 
8. 4564968+00 
-2. 1345198+01 
3. 5226398+00 
-7. 7384688+00 
5. 7056288+00 
3. 0765948+01 
4. 7872498+00 
-1.6999268+01 
£. 1986078+00 
7.2633348-01 
1.3305228+00 


4. 4347358+00 
-1.6861488+01 
1.0390898+01 
-7. 258784b+00 
-5. 4455338+00 
-1. 1028578+01 
4. 0045558+00 
-4. 0988708+00 
-6. 0580048+00 
1.0073598+00 
2.4051648+01 
-6. 8694048+00 
1.2222488+01 
-1.8576468+01 
1.6066328+01 
-2. 4852788+01 
-1.7612468+01 
-8. 3106628+00 


1.5536738+00 
1.2347568+01 
-8. 4419398+00 
-4. 3450258+00 
8. 7559608+00 
1.0763888+01 
1.0177988+01 
8. 3732998+00 
8. 5668978+00 
2. 6072218+01 
1.339754»+01 
-9. 4667808+00 
8.4163128-01 
2. 9088578-01 
-1.8244488+01 
1.2157858+01 
6. 3541368-01 
-2. 8587518-02 


-1.0194668+01 
8. 1479678+00 
-7.0386138+00 
-2. 4430158+00 
3. 2943898+00 
-9. 7404708+00 
-9. 1862208+00 
-5.3161178-01 
-6. 6276818+00 
9.9104938+00 
1.8446848+01 
-2. 4732778+01 
1.4293028+00 
3.27  2178+00 
-8.  49J  . 7748+00 
-7.  82  ,4858+00 
-2. 4004698+00 
-2.72:5238+01 


RESIDUAL  VARIANCE  *  1.2123988+02 

COVARIANCE  MATRIX  CF  ESTIMATES* 


1.9733008-03 

-1.5910238-03 

-7.2745198-04 

1.3787550-04 

7. 93  3710-04 

-2. 1067888-04 

-1.5910238-03 

3. 2212238-03 

-9.0839850-04 

-8. 14  5430-04 

-5. 9211038-04 

7. 9680308-04 

-7. 2745278-04 

-9. 083981< 

*-04 

3.  16  5120-03 

-1.025503e-03 

-7. 9864888-04 

1.2236048-04 

1.3787570-04 

-8. 14  :539o-04 

-1. 025303e-03 

3. 1651468-03 

-9.2519538-04 

-7.  153397* 

*—04 

7.9:  0718-04 

-5.921111e-04 

-7. 9864798-04 

-9.2519518-04 

3.221667) 

»— 03 

-1.58  9410-03 

-2. 106787e— 04 

7. 9680328-04 

1.2236028-04 

-7.  153401) 

*-04 

-1.58,19410-03 

1. 9708808-03 

STANDARD  ERRORS: 

4. 442183e-02 

5. 6755828-32 

5.  6227338-02 

5.  625963) 

*—02 

5.67  9730-02 

4. 439459e— 02 

CORRELATION  MATRIX  OF  ESTIMATES 

• 

8 

1 . 0000008+00 

-6. 3105838-01 

-2.9124628-01 

5.516880 

32 

3.  14  5210-01 

-1. 068302e-01 

-6.3105828-31 

1 . 0000008+00 

-2.  846546 

01 

-2.55  074e-01 

-1. 838027e-01 

3. 162354e-31 

-2.912465e-01 

-2.  846547 

01 

1.00  0008+00 

-3. 2418478-01 

-2. 5024658-01 

4.901887e-02 

5.51688S 

02 

-2.55  0728-01 

-3.2^-18488-01 

1 . 0000008+00 

-2.  8973186-01 

-2. 864081 

31 

3.14  5228-01 

- 1 . 838029e-0 1 

-2. 5024628-01 

-2. 8973178-01 

1.  000000 

00 

-6.28  9178-01 

-1. 06S302e-01 

3. 1623548-01 

4.9018808-02 

-2.  864083 

31 

-6.28  9148-01 

1. 000000e+00 

RESIDUAL  AUTOCORRELATIONS: 

1 . 0000008+00 

3. 4734428-03 

1.985737e-02 

-3.  923553 

33 

5.20  *240-02 

3.7227518-03 

2. 157055e-02 

-4. 653008e-02 

1.455601 

32 

-4.  47i  *010-02 

5. 233048e-02 

-3. 6964668-02 

9. 0243748-03 

5.  127612 

02 

1.  701  f 83o-02 

9.2091558-02 

4.7661538-02 

-4. 9736128-02 

4.  768314 

02 

-1.05S  )30o-01 

4. 5555508-02 

-1. 1380148-01 

4. 626628e-02 

-6.  736232 

04 

-2.  059  '560-02 

1. 318120e-02 

-3. 754254e-02 

-8. 7968808-02 

-4.  394097 

02 

-3.  85  U  .’£00-02 
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7. 9687856-02 
-2. 076864e-02 
2.  563546e-02 
7. 3720406-02 
4.9001316-02 
2. 659655e-02 


-3. 0334166-02 
-3. 3542696-02 
-7.4019196-02 
-4. 3273716-02 
-4. 6733726-02 
-2. 8043236-02 


-6. 5806366-02 
-4. 9384836-02 
-6. 9407936-02 
-3. 2776496-02 
-5. 7613866-02 


-1.8840991  -02 
3.  921619i  -02 
-6. 397688c  -02 
1 . 397328<  -02 
1.716637.  -02 


-1. 1301126-01 
-7. 593037e-02 
-3. 2523346-02 
-1.2071376-01 
-4. 4435176-02 


CHI-SQUARE  STATISTIC  -  8.1374346+01 


DEGREES  OF  FREEDOM 


50 


